Favicon for togethercomputer

StripedHyena Nous 7B

togethercomputer/stripedhyena-nous-7b

Model weights

This is the chat model variant of the StripedHyena series developed by Together in collaboration with Nous Research.

StripedHyena uses a new architecture that competes with traditional Transformers, particularly in long-context data processing. It combines attention mechanisms with gated convolutions for improved speed, efficiency, and scaling. This model marks a significant advancement in AI architecture for sequence modeling tasks.

Modalities
Context
33K
Released
Dec 9, 2023
Knowledge cutoff
Jun 2023

Activity

Token volume and request traffic to this model over time.

Not currently available through EU in-region routing. In-region routing docs

Frequently asked questions

Explore more models