Fields
| Field | Type | Required | Description | Example |
|---|---|---|---|---|
context_length | int | :heavy_check_mark: | N/A | |
latency_last_30m | Nullable[components.PercentileStats] | :heavy_check_mark: | Latency percentiles in milliseconds over the last 30 minutes. Latency measures time to first token. Only visible when authenticated with an API key or cookie; returns null for unauthenticated requests. | { “p50”: 25.5, “p75”: 35.2, “p90”: 48.7, “p99”: 85.3 } |
max_completion_tokens | Nullable[int] | :heavy_check_mark: | N/A | |
max_prompt_tokens | Nullable[int] | :heavy_check_mark: | N/A | |
model_id | str | :heavy_check_mark: | The unique identifier for the model (permaslug) | openai/gpt-4 |
model_name | str | :heavy_check_mark: | N/A | |
name | str | :heavy_check_mark: | N/A | |
pricing | components.Pricing | :heavy_check_mark: | N/A | |
provider_name | components.ProviderName | :heavy_check_mark: | N/A | OpenAI |
quantization | Nullable[components.PublicEndpointQuantization] | :heavy_check_mark: | N/A | fp16 |
status | Optional[components.EndpointStatus] | :heavy_minus_sign: | N/A | 0 |
supported_parameters | List[components.Parameter] | :heavy_check_mark: | N/A | |
supports_implicit_caching | bool | :heavy_check_mark: | N/A | |
tag | str | :heavy_check_mark: | N/A | |
throughput_last_30m | Nullable[components.PercentileStats] | :heavy_check_mark: | N/A | { “p50”: 25.5, “p75”: 35.2, “p90”: 48.7, “p99”: 85.3 } |
uptime_last_1d | Nullable[float] | :heavy_check_mark: | Uptime percentage over the last 1 day, calculated as successful requests / (successful + error requests) * 100. Rate-limited requests are excluded. Returns null if insufficient data. | |
uptime_last_30m | Nullable[float] | :heavy_check_mark: | N/A | |
uptime_last_5m | Nullable[float] | :heavy_check_mark: | Uptime percentage over the last 5 minutes, calculated as successful requests / (successful + error requests) * 100. Rate-limited requests are excluded. Returns null if insufficient data. |