- Notifications
You must be signed in to change notification settings - Fork1k
Open
Labels
Description
Initial Checks
- I confirm that I'm using the latest version of Pydantic AI
- I confirm that I searched for my issue inhttps://github.com/pydantic/pydantic-ai/issues before opening this issue
Description
Structured streaming doesn't work with Claude models when using via Bedrock.
I tried using stream whales example as-is and it seems to work fine with the openai gpt model used in that example.
When using a Claude model, the streaming does not work and data is sent as one chunk.
Can confirm if I change output type to just a string, streaming works fine but in my use case I need structured output.
I have seen similar issues when using Claude models directly:
Example Code
Python, Pydantic AI & LLM client version
Python 3.12PydanticAI 0.2.12