- Notifications
You must be signed in to change notification settings - Fork1.1k
docs: add client configuration section and support matrix for AI Bridge#20640
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to ourterms of service andprivacy statement. We’ll occasionally send you account related emails.
Already on GitHub?Sign in to your account
base:main
Are you sure you want to change the base?
Conversation
…r additional providersRevised the AI Bridge documentation to clarify provider configuration steps, including new sections for OpenAI, Anthropic, and Amazon Bedrock. Added details on pre-configuring templates and using AI Bridge with Coder Tasks. Introduced a new image illustrating the AI Bridge implementation details. Updated compatibility notes for various AI clients.Addressescoder/aibridge#4
c9c35ac to52f51bcCompareRevised client support table for enhanced clarity.
52f51bc to458890fCompareThere was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others.Learn more.
If you've got time to address this high level feedback before release, let's do it. If not, let's make it happen quickly after. It's not a hard requirement for merge, but I don't want to let it hang out too long...
This page is getting MaSSiVe 😂. Can we break it up into a top-level "AI Bridge" w/ the summary, then sub pages covering (this is just a first stab, feel free to riff on the sub page breakdown)
- Setup
- Client Config
- MCP
- Monitoring
- Reference (super technical documentation)
Uh oh!
There was an error while loading.Please reload this page.
Uh oh!
There was an error while loading.Please reload this page.
Uh oh!
There was an error while loading.Please reload this page.
Uh oh!
There was an error while loading.Please reload this page.
Uh oh!
There was an error while loading.Please reload this page.
Uh oh!
There was an error while loading.Please reload this page.
Uh oh!
There was an error while loading.Please reload this page.
Splits the AI Bridge documentation into multiple pages to improve readability and navigation.
I have addressed the feedback and pushed the changes. |
3e24b0d to33c54eaCompareUh oh!
There was an error while loading.Please reload this page.
Use "AI Bridge" consistently across the documentation, replacing instances of "Bridge." Adjust headings and content throughout to ensure clarity and alignment with the AI Bridge branding.
68daf40 to82aa5dcCompare- Capitalize section headings for consistency.- Use the singular form for "provider" for clarity.- Ensure document syntax matches Coder documentation style guidelines.
Uh oh!
There was an error while loading.Please reload this page.
Uh oh!
There was an error while loading.Please reload this page.
Uh oh!
There was an error while loading.Please reload this page.
Uh oh!
There was an error while loading.Please reload this page.
Uh oh!
There was an error while loading.Please reload this page.
Uh oh!
There was an error while loading.Please reload this page.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others.Learn more.
Really liking the reorganisation.
Pausing here for the moment; ran out of time to review.
I've only reviewed up to the start of Client Config page, in the order of how it appears on the website.
Thanks for providing a docs preview link, that was very helpful.
| 1.**Centralized authn/z management**: no more issuing & managing API tokens for OpenAI/Anthropic usage. | ||
| Users use their Coder session or API tokens to authenticate with`coderd` (Coder control plane), and | ||
| `coderd` securely communicates with the upstream APIs on their behalf. Use a single key for all users. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others.Learn more.
| `coderd` securely communicates with the upstream APIs on their behalf. Use a single key for all users. | |
| `coderd` securely communicates with the upstream APIs on their behalf. |
| 2.**Auditing and attribution**: all interactions with AI services, whether autonomous or human-initiated, | ||
| will be audited and attributed back to a user. | ||
| 3.**Centralized MCP administration**: define a set of approved MCP servers and tools which your users may | ||
| use, and prevent users from using their own. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others.Learn more.
| use, and prevent users from using their own. | |
| use. |
This is not possible yet.
| ##When to use AI Bridge | ||
| As the library of LLMs and their associated tools grow, administrators are pressured to provide auditing, measure adoption, provide tools through MCP, and track token spend. Disparate SAAS platforms provide_some_ of these for_some_ tools, but there is no centralized, secure solution for these challenges. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others.Learn more.
| As the library of LLMs and their associated tools grow, administrators are pressured toprovide auditing, measure adoption, provide tools through MCP, and track token spend. Disparate SAAS platforms provide_some_ofthese for_some_ tools, but there is no centralized, secure solution for these challenges. | |
| AI Bridge enables organizations to roll out access to AI tooling for up tothousandsofengineers. |
| If you are an administrator or devops leader looking to: | ||
| - Measure AI tooling adoption across teams or projects | ||
| - Provide an LLM audit trail to security administrators |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others.Learn more.
| -Provide anLLMaudit trailto security administrators | |
| -Establish an audit trailof prompts issues and tools invoked |
| - Provide an LLM audit trail to security administrators | ||
| - Manage token spend in a central dashboard | ||
| - Investigate opportunities for AI automation | ||
| - Uncover the high-leverage use cases from experienced engineers |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others.Learn more.
| - Uncoverthehigh-leverage use cases from experienced engineers | |
| - Uncover high-leverage use cases |
| -`CODER_AIBRIDGE_ANTHROPIC_KEY` or`--aibridge-anthropic-key` | ||
| -`CODER_AIBRIDGE_ANTHROPIC_BASE_URL` or`--aibridge-anthropic-base-url` | ||
| The default base URL (`https://api.anthropic.com/`) targets Anthropic's public API. Override it for Anthropic-compatible brokers. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others.Learn more.
Ditto
| ###Amazon Bedrock | ||
| Set the following when routing Amazon Bedrock traffic through AI Bridge: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others.Learn more.
For all of these sections, please link to the reference page likehttps://coder.com/docs/@aibridge-client-instructions/reference/cli/server#--aibridge-bedrock-region.
| Instead of distributing provider-specific API keys (OpenAI/Anthropic keys) to users, they authenticate to AI Bridge using their**Coder session token** or**API key**: | ||
| -**OpenAI clients**: Users set`OPENAI_API_KEY` to their Coder session token or API key | ||
| -**Anthropic clients**: Users set`ANTHROPIC_API_KEY` to their Coder session token or API key |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others.Learn more.
Have you tested this? I've only testedANTHROPIC_AUTH_TOKEN in Claude Code.
| Template admins can pre-configure workspaces to route all AI tool requests through AI Bridge, providing a seamless and secure experience for users. This can be done for both Coder Tasks and other AI tools running in the workspace. | ||
| ###Using Coder Tasks |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others.Learn more.
This doesn't have anything to do with Tasks.
The majority of customers won't be using Tasks (yet) so let's optimize for phrasing this as normal templates.
It's good that you mention that Tasks can be used with Bridge, though.
| } | ||
| ``` | ||
| This setup keeps agent execution within Coder while applying the same auditing and MCP policies as IDE clients. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others.Learn more.
Not really sure what you're trying to convey here; maybe rephrase?
Uh oh!
There was an error while loading.Please reload this page.
Revised the AI Bridge documentation to clarify provider configuration steps, including new sections for OpenAI, Anthropic, and Amazon Bedrock. Added details on pre-configuring templates and using AI Bridge with Coder Tasks. Introduced a new image illustrating the AI Bridge implementation details. Updated compatibility notes for various AI clients.
Addressescoder/aibridge#4
Preview:https://coder.com/docs/@aibridge-client-instructions/ai-coder/ai-bridge