AI21: Jamba 1.5 Mini
ai21/jamba-1-5-mini
Created Aug 23, 2024256,000 context
$0.2/M input tokens$0.4/M output tokens
Jamba 1.5 Mini is the world's first production-grade Mamba-based model, combining SSM and Transformer architectures for a 256K context window and high efficiency.
It works with 9 languages and can handle various writing and analysis tasks as well as or better than similar small models.
This model uses less computer memory and works faster with longer texts than previous designs.
Read their announcement to learn more.