ProviderResponse - Python SDK

ProviderResponse method reference

The Python SDK and docs are currently in beta. Report issues on GitHub.

Details of a provider response for a generation attempt

Fields

FieldTypeRequiredDescriptionExample
endpoint_idOptional[str]Internal endpoint identifierep_abc123
idOptional[str]Upstream provider response identifierchatcmpl-abc123
is_byokOptional[bool]Whether the request used a bring-your-own-keyfalse
latencyOptional[float]Response latency in milliseconds1200
model_permaslugOptional[str]Canonical model slugopenai/gpt-4
provider_nameOptional[components.ProviderResponseProviderName]Name of the providerOpenAI
statusNullable[int]✔️HTTP status code from the provider200