Mistral: Codestral Mamba

mistralai/codestral-mamba

Created Jul 19, 2024262,144 context

$0.25/M input tokens$0.25/M output tokens

A 7.3B parameter Mamba-based model designed for code and reasoning tasks.

Linear time inference, allowing for theoretically infinite sequence lengths
256k token context window
Optimized for quick responses, especially beneficial for code productivity
Performs comparably to state-of-the-art transformer models in code and reasoning tasks
Available under the Apache 2.0 license for free use, modification, and distribution

Sample code and API for Codestral Mamba

OpenRouter normalizes requests and responses across providers for you.

OpenRouter provides an OpenAI-compatible completion API to 300+ models & providers that you can call directly, or using the OpenAI SDK. Additionally, some third-party SDKs are available.

In the examples below, the OpenRouter-specific headers are optional. Setting them allows your app to appear on the OpenRouter leaderboards.

from openai import OpenAI

client = OpenAI(
  base_url="https://openrouter.ai/api/v1",
  api_key="<OPENROUTER_API_KEY>",
)

completion = client.chat.completions.create(
  extra_headers={
    "HTTP-Referer": "<YOUR_SITE_URL>", # Optional. Site URL for rankings on openrouter.ai.
    "X-Title": "<YOUR_SITE_NAME>", # Optional. Site title for rankings on openrouter.ai.
  },
  extra_body={},
  model="mistralai/codestral-mamba",
  messages=[
    {
      "role": "user",
      "content": "What is the meaning of life?"
    }
  ]
)
print(completion.choices[0].message.content)

Using third-party SDKs

For information about using third-party SDKs and frameworks with OpenRouter, please see our frameworks documentation.

See the Request docs for all possible fields, and Parameters for explanations of specific sampling parameters.