Anthropic: Claude 3.5 Haiku (2024-10-22) (self-moderated)

anthropic/claude-3-5-haiku-20241022:beta

Created Nov 4200,000 context

$1/M input tokens$5/M output tokens

Claude 3.5 Haiku features enhancements across all skill sets including coding, tool use, and reasoning. As the fastest model in the Anthropic lineup, it offers rapid response times suitable for applications that require high interactivity and low latency, such as user-facing chatbots and on-the-fly code completions. It also excels in specialized tasks like data extraction and real-time content moderation, making it a versatile tool for a broad range of industries.

It does not support image inputs.

See the launch announcement and benchmark results here

Providers for Claude 3.5 Haiku (2024-10-22) (self-moderated)

OpenRouter load-balances requests across providers weighted by price unless you use dynamic routing.

Apps using Claude 3.5 Haiku (2024-10-22) (self-moderated)

Top public apps this week using this model

Recent activity on Claude 3.5 Haiku (2024-10-22) (self-moderated)

Tokens processed per day

Uptime stats for Claude 3.5 Haiku (2024-10-22) (self-moderated)

Uptime stats for Claude 3.5 Haiku (2024-10-22) (self-moderated) across all providers

Sample code and API for Claude 3.5 Haiku (2024-10-22) (self-moderated)

OpenRouter normalizes requests and responses across providers for you.

OpenRouter provides an OpenAI-compatible completion API to 0 models & providers that you can call directly, or using the OpenAI SDK. Additionally, some third-party SDKs are available.

In the examples below, the OpenRouter-specific headers are optional. Setting them allows your app to appear on the OpenRouter leaderboards.

Using the OpenAI SDK

import OpenAI from "openai"

const openai = new OpenAI({
  baseURL: "https://openrouter.ai/api/v1",
  apiKey: $OPENROUTER_API_KEY,
  defaultHeaders: {
    "HTTP-Referer": $YOUR_SITE_URL, // Optional, for including your app on openrouter.ai rankings.
    "X-Title": $YOUR_APP_NAME, // Optional. Shows in rankings on openrouter.ai.
  }
})

async function main() {
  const completion = await openai.chat.completions.create({
    model: "anthropic/claude-3-5-haiku-20241022:beta",
    messages: [
      {
        "role": "user",
        "content": "What is the meaning of life?"
      }
    ]
  })

  console.log(completion.choices[0].message)
}
main()

Using the OpenRouter API directly

fetch("https://openrouter.ai/api/v1/chat/completions", {
  method: "POST",
  headers: {
    "Authorization": `Bearer ${OPENROUTER_API_KEY}`,
    "HTTP-Referer": `${YOUR_SITE_URL}`, // Optional, for including your app on openrouter.ai rankings.
    "X-Title": `${YOUR_SITE_NAME}`, // Optional. Shows in rankings on openrouter.ai.
    "Content-Type": "application/json"
  },
  body: JSON.stringify({
    "model": "anthropic/claude-3-5-haiku-20241022:beta",
    "messages": [
      {
        "role": "user",
        "content": "What is the meaning of life?"
      }
    ]
  })
});

Using third-party SDKs

Olympia has created a Ruby SDK: OpenRouter Client

See the Request docs for all possible parameters, and Parameters for recommended values.