Hugging Face: Zephyr 7B (free)

huggingfaceh4/zephyr-7b-beta:free

Updated Aug 24,096 context

$0/M input tokens$0/M output tokens

Zephyr is a series of language models that are trained to act as helpful assistants. Zephyr-7B-β is the second model in the series, and is a fine-tuned version of mistralai/Mistral-7B-v0.1 that was trained on a mix of publicly available, synthetic datasets using Direct Preference Optimization (DPO).

These are free, rate-limited endpoints for Zephyr 7B. Outputs may be cached. Read about rate limits here.

Providers for Zephyr 7B (free)

OpenRouter load-balances requests across providers weighted by price unless you use dynamic routing.

Apps using Zephyr 7B (free)

Top public apps this week using this model

Recent activity on Zephyr 7B (free)

Tokens processed per day

Uptime stats for Zephyr 7B (free)

Uptime stats for Zephyr 7B (free) across all providers

Sample code and API for Zephyr 7B (free)

OpenRouter normalizes requests and responses across providers for you.

To get started, you can use Zephyr 7B (free) via API like this:

fetch("https://openrouter.ai/api/v1/chat/completions", {
  method: "POST",
  headers: {
    "Authorization": `Bearer ${OPENROUTER_API_KEY}`,
    "HTTP-Referer": `${YOUR_SITE_URL}`, // Optional, for including your app on openrouter.ai rankings.
    "X-Title": `${YOUR_SITE_NAME}`, // Optional. Shows in rankings on openrouter.ai.
    "Content-Type": "application/json"
  },
  body: JSON.stringify({
    "model": "huggingfaceh4/zephyr-7b-beta:free",
    "messages": [
      {"role": "user", "content": "What is the meaning of life?"},
    ],
  })
});

You can also use OpenRouter with OpenAI's client API:

import OpenAI from "openai"

const openai = new OpenAI({
  baseURL: "https://openrouter.ai/api/v1",
  apiKey: $OPENROUTER_API_KEY,
  defaultHeaders: {
    "HTTP-Referer": $YOUR_SITE_URL, // Optional, for including your app on openrouter.ai rankings.
    "X-Title": $YOUR_SITE_NAME, // Optional. Shows in rankings on openrouter.ai.
  }
})
async function main() {
  const completion = await openai.chat.completions.create({
    model: "huggingfaceh4/zephyr-7b-beta:free",
    messages: [
      { role: "user", content: "Say this is a test" }
    ],
  })

  console.log(completion.choices[0].message)
}
main()

See the Request docs for all possible parameters, and Parameters for recommended values.