StripedHyena Nous 7B


Updated Dec 932,768 context
$0.18/M input tkns$0.18/M output tkns

This is the chat model variant of the StripedHyena series developed by Together in collaboration with Nous Research.

StripedHyena uses a new architecture that competes with traditional Transformers, particularly in long-context data processing. It combines attention mechanisms with gated convolutions for improved speed, efficiency, and scaling. This model marks a significant advancement in AI architecture for sequence modeling tasks.