You signed in with another tab or window.Reload to refresh your session.You signed out in another tab or window.Reload to refresh your session.You switched accounts on another tab or window.Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/ai-coder/ai-bridge.md
+36-7Lines changed: 36 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -3,6 +3,8 @@
3
3
>[!NOTE]
4
4
>AI Bridge is currently an_experimental_ feature.
5
5
6
+

7
+
6
8
AI Bridge is a smart proxy for AI. It acts as a man-in-the-middle between your users' coding agents / IDEs
7
9
and AI providers like OpenAI and Anthropic. By intercepting all the AI traffic between these clients and
8
10
the upstream APIs, AI Bridge can record user prompts, token usage, and tool invocations.
@@ -17,12 +19,27 @@ AI Bridge solves 3 key problems:
17
19
3.**Centralized MCP administration**: define a set of approved MCP servers and tools which your users may
18
20
use, and prevent users from using their own.
19
21
22
+
###When to use AI Bridge
23
+
24
+
As the library of LLMs and their associated tools grow, administrators are pressured to provide auditing, measure adoption, provide tools through MCP, and track token spend. Disparate SAAS platforms provide_some_ of these for_some_ tools, but there is no centralized, secure solution for these challenges.
25
+
26
+
If you are administrator or devops leader looking to:
27
+
- Measure AI tooling adoption across teams or projects
28
+
- Provide an LLM audit trail to security administrators
29
+
- Manage token spend in a central dashboard
30
+
- Investigate opportunities for AI automation
31
+
- Uncover the high-leverage use cases from experienced engineers
32
+
33
+
We advise trying Bridge as self-hosted proxy to monitor LLM usage agnostically across AI powered IDEs like Cursor and headless agents like Claude Code.
34
+
20
35
##Setup
21
36
37
+
AI Bridge runs inside the Coder control plane, requiring no separate compute to deploy or scale. Once enabled,`coderd` hosts the bridge in-memory and brokers traffic to your configured AI providers on behalf of authenticated users.
38
+
22
39
**Required**:
23
40
24
-
1. A**Premium**license
25
-
1. Feature must be[enabled](#activation)
41
+
1. A**premium**licensed Coder deployment
42
+
1. Feature must be[enabled](#activation) using the server flag
26
43
1. One or more[provider](#providers) API keys must be configured
27
44
28
45
###Activation
@@ -56,8 +73,7 @@ The API to which AI Bridge will relay requests.
If you're using_[Google Vertex AI](https://cloud.google.com/vertex-ai?hl=en)_,_[AWS Bedrock](https://aws.amazon.com/bedrock/)_, or others,
60
-
you may specify the base URL(s) above to the appropriate API endpoint.
76
+
AI bridge is compatible with_[Google Vertex AI](https://cloud.google.com/vertex-ai?hl=en)_,_[AWS Bedrock](https://aws.amazon.com/bedrock/)_, and other LLM brokers. You may specify the base URL(s) above to the appropriate API endpoint for your provider.
61
77
62
78
---
63
79
@@ -69,10 +85,19 @@ you may specify the base URL(s) above to the appropriate API endpoint.
69
85
AI Bridge collects:
70
86
71
87
- The last`user` prompt of each request
72
-
- All token usage
73
-
- All tool invocations
88
+
- All token usage (associated with each prompt)
89
+
- Every tool invocation
90
+
91
+
All of these records are associated to an "interception" record, which maps 1:1 with requests received from clients but may involve several interactions with upstream providers. Interceptions are associated with a Coder identity, allowing you to map consumption and cost with teams or individuals in your organization:
74
92
75
-
All of these records are associated to an "interception" record, which maps 1:1 with requests received from clients but may involve several interactions with upstream providers.
These logs can be used to determine usage patterns, track costs, and evaluate tooling adoption.
97
+
98
+
This data is currently accessible through the API and CLI (experimental), which we advise administrators export to their observability platform of choice. We've configured a Grafana dashboard to display Claude Code usage internally which can be imported as a starting point for your tooling adoption metrics.
To report a bug, file a feature request, or see a list of known issues please see our Github repository for Bridge. If you encounter issues with Bridge during early access, please contact our Support team or reach out via our Discord.