#
llm-gateway-system
Here is 1 public repository matching this topic...
LLM Router is a service that can be deployed on‑premises or in the cloud. It adds a layer between any application and the LLM provider. In real time it controls traffic, distributes a load among providers of a specific LLM, and enables analysis of outgoing requests from a security perspective (masking, anonymization, prohibited content).
automationcloudrest-apimodel-managementload-balancingon-premgenaillm-routerllm-gatewayllm-gateway-systemllm-balancing
- Updated
Nov 28, 2025 - Python
Improve this page
Add a description, image, and links to thellm-gateway-system topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with thellm-gateway-system topic, visit your repo's landing page and select "manage topics."