Mistral: Mistral 7B Instruct v0.2
mistralai/mistral-7b-instruct-v0.2
Created Dec 28, 202332,768 context
$0.18/M input tokens$0.18/M output tokens
A high-performing, industry-standard 7.3B parameter model, with optimizations for speed and context length.
An improved version of Mistral 7B Instruct, with the following changes:
- 32k context window (vs 8k context in v0.1)
- Rope-theta = 1e6
- No Sliding-Window Attention