Important

Enhance OpenAI-compatible endpoints with detailed token usage information, including cached and reasoning tokens, across various providers.

• Behavior:
  • Adds detailed token usage information to OpenAI-compatible endpoints (/chat/completions and/embeddings).
  • Includes fields forcached_tokens,reasoning_tokens,audio_tokens,accepted_prediction_tokens, andrejected_prediction_tokens.
  • Details are conditionally included based on provider support.
• Models:
  • UpdatesUsage struct inusage.rs to includeinput_tokens_details andoutput_tokens_details.
  • AddsInputTokensDetails andOutputTokensDetails structs for detailed token breakdown.
• Documentation:
  • Updatesinference-openai-compatible.mdx anddata-model.mdx to document new usage details.
  • Addsusage-details.mdx to explain token usage details and provider support.
• Tests:
  • Modifies tests inexact_match.rs,tests.rs, and other files to validate new usage details.
  • Adds tests for strict summation of usage details and JSON serialization behavior.

^{This description was created by for5bfc8cd. You cancustomize this summary. It will automatically update as commits are pushed.}