- Notifications
You must be signed in to change notification settings - Fork17
Remove nano from docs, benchmark results, examples#43
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to ourterms of service andprivacy statement. We’ll occasionally send you account related emails.
Already on GitHub?Sign in to your account
Uh oh!
There was an error while loading.Please reload this page.
Conversation
steven10a commentedNov 4, 2025
- Removed nano from the benchmark results
- Updated graphs to not include nano models
- Removed from any examples or code snippets in the docs
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others.Learn more.
Pull Request Overview
This PR removes references to deprecated "nano" model variants (gpt-4.1-nano and gpt-5-nano) throughout the codebase, replacing them with "mini" variants where appropriate. This appears to be a cleanup effort to deprecate support for these model versions.
- Removed
gpt-4.1-nanoandgpt-5-nanofrom the default benchmark models list - Updated all example code and tests to use
gpt-4.1-miniinstead ofgpt-4.1-nano - Cleaned up documentation tables to remove nano model benchmark results
Reviewed Changes
Copilot reviewed 19 out of 23 changed files in this pull request and generated no comments.
Show a summary per file
| File | Description |
|---|---|
| src/guardrails/evals/guardrail_evals.py | Removed nano variants from DEFAULT_BENCHMARK_MODELS list and updated help text |
| src/guardrails/evals/README.md | Removed gpt-5-nano from example commands |
| src/guardrails/checks/text/jailbreak.py | Updated documentation example to use gpt-4.1-mini instead of gpt-4.1-nano |
| tests/integration/test_suite.py | Replaced all gpt-4.1-nano references with gpt-4.1-mini in test configurations |
| examples/implementation_code/streaming/*.py | Updated streaming examples to use gpt-4.1-mini |
| examples/implementation_code/blocking/*.py | Updated blocking examples to use gpt-4.1-mini |
| examples/basic/*.py | Updated all basic examples to use gpt-4.1-mini |
| docs/ref/checks/*.md | Removed nano model entries from performance benchmark tables and updated formatting |
| docs/evals.md | Removed gpt-5-nano from example command |
💡Add Copilot custom instructions for smarter, more guided reviews.Learn how to get started.
gabor-openai left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others.Learn more.
TY!
0a65199 intomainUh oh!
There was an error while loading.Please reload this page.