Mistral: Mixtral 8x7B Instruct
mistralai/mixtral-8x7b-instruct
Created Dec 10, 202332,768 context
$0.08/M input tokens$0.24/M output tokens
Providers for Mixtral 8x7B Instruct
OpenRouter routes requests to the best providers that are able to handle your prompt size and parameters, with fallbacks to maximize uptime.
DE fp8 | Context 33K Max Output 33K Input $0.08 Output $0.24 |
US fp8 | Context 33K Max Output 16K Input $0.24 Output $0.24 |
US | Context 33K Max Output 2K Input $0.60 Output $0.60 |
1.
One API
AI key management system
854Mtokens
2.
liteLLM
Open-source library to simplify LLM calls
32.5Mtokens
3.
chathub.gg
new
7.36Mtokens
4.
Universal Ecommerce Parser
new
5.34Mtokens
5.
Caveduck
AI character chat
4.12Mtokens
6.
SillyTavern
LLM frontend for power users
3.26Mtokens
7.
Cline
Autonomous coding agent right in your IDE
2.2Mtokens
8.
Mantella
Skyrim & Fallout 4 mod, naturally speak to NPCs
1.1Mtokens
9.
Actioner AI
new
895Ktokens
10.
OpenRouter: Chatroom
Chat with multiple LLMs at once
699Ktokens
11.
Chub AI
GenAI for everyone
551Ktokens
12.
RisuAI
Browse characters, choose models, and chat
533Ktokens
13.
Voxta
Your speech-driven AI companion backend
361Ktokens
14.
AI Chat Platform
new
342Ktokens
15.
AI Writing Companion
new
316Ktokens
16.
talktweak.com
new
306Ktokens
17.
FlashCell WhatsApp Consulta
new
271Ktokens
18.
OpenCharacter
Open-source recreation of the old c.ai site
240Ktokens
19.
Straico
Multi-model AI for content & image generation
205Ktokens
20.
KilnAI
new
170Ktokens
When an error occurs in an upstream provider, we can recover by routing to another healthy provider, if your request filters allow it.
Learn more about our load balancing and customization options.
Sample code and API for Mixtral 8x7B Instruct
OpenRouter normalizes requests and responses across providers for you.
OpenRouter provides an OpenAI-compatible completion API to 300+ models & providers that you can call directly, or using the OpenAI SDK. Additionally, some third-party SDKs are available.
In the examples below, the OpenRouter-specific headers are optional. Setting them allows your app to appear on the OpenRouter leaderboards.
from openai import OpenAI
client = OpenAI(
base_url="https://openrouter.ai/api/v1",
api_key="<OPENROUTER_API_KEY>",
)
completion = client.chat.completions.create(
extra_headers={
"HTTP-Referer": "<YOUR_SITE_URL>", # Optional. Site URL for rankings on openrouter.ai.
"X-Title": "<YOUR_SITE_NAME>", # Optional. Site title for rankings on openrouter.ai.
},
extra_body={},
model="mistralai/mixtral-8x7b-instruct",
messages=[
{
"role": "user",
"content": "What is the meaning of life?"
}
]
)
print(completion.choices[0].message.content)
Using third-party SDKs
For information about using third-party SDKs and frameworks with OpenRouter, please see our frameworks documentation.
See the Request docs for all possible fields, and Parameters for explanations of specific sampling parameters.