Hello Folks,

Thanks for the truly excellent work.
Anthropic has a substantial discount on batching calls to their models.https://www.anthropic.com/pricing#anthropic-api
I want to leverage this while using Pydantic AI.

My use case is that I want to build an app that may have many concurrent users and am considering batching calls to the LLM to reduce cost.
Does anyone know how this may be done (or worth doing)?

Thanks!