- Notifications
You must be signed in to change notification settings - Fork1k
Open
Description
Description
Hello, i am testing a port of my agentic app to Pydantic AI, and i would like to request easy support prompt caching ["cache-control"] = {"type": "ephemeral"} for Anthropic models.
I find that my costs are reduced by half when i enable this feature in my current app, and i think lots of people would find it beneficial. At the moment i am caching tool calls and system prompt.
Thanks in advance.
References
https://docs.anthropic.com/en/docs/build-with-claude/prompt-caching
Metadata
Metadata
Assignees
Labels
No labels