Usage - Python SDK

Usage method reference

The Python SDK and docs are currently in beta. Report issues on GitHub.

Token usage information for the response

Fields

FieldTypeRequiredDescription
input_tokensint✔️N/A
input_tokens_detailscomponents.InputTokensDetails✔️N/A
output_tokensint✔️N/A
output_tokens_detailscomponents.OutputTokensDetails✔️N/A
total_tokensint✔️N/A
costOptionalNullable[float]Cost of the completion
cost_detailsOptional[components.UsageCostDetails]N/A
is_byokOptional[bool]Whether a request was made using a Bring Your Own Key configuration