The highest tagged major version isv9.
inference/
directory v8.19.1
Go to latest Published: Dec 12, 2025 License:Apache-2.0
Opens a new window with list of versions in this module.
Latest Latest
This package is not in the latest version of its module.
Opens a new window with license information.
Details
Validgo.mod file
The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
- Redistributable license
Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
- Tagged version
Modules with tagged versions give importers more predictable builds.
- Stable version
When a project reaches major version v1 it is considered stable.
- Learn more about best practices
Repository
Links
Open Source Insights
Directories¶
| Path | Synopsis |
|---|---|
Perform chat completion inference | Perform chat completion inference |
Perform completion inference on the service | Perform completion inference on the service |
Delete an inference endpoint | Delete an inference endpoint |
Get an inference endpoint | Get an inference endpoint |
Perform inference on the service. | Perform inference on the service. |
Create an inference endpoint. | Create an inference endpoint. |
Create an AlibabaCloud AI Search inference endpoint. | Create an AlibabaCloud AI Search inference endpoint. |
Create an Amazon Bedrock inference endpoint. | Create an Amazon Bedrock inference endpoint. |
Create an Amazon SageMaker inference endpoint. | Create an Amazon SageMaker inference endpoint. |
Create an Anthropic inference endpoint. | Create an Anthropic inference endpoint. |
Create an Azure AI studio inference endpoint. | Create an Azure AI studio inference endpoint. |
Create an Azure OpenAI inference endpoint. | Create an Azure OpenAI inference endpoint. |
Create a Cohere inference endpoint. | Create a Cohere inference endpoint. |
Create a custom inference endpoint. | Create a custom inference endpoint. |
Create a DeepSeek inference endpoint. | Create a DeepSeek inference endpoint. |
Create an Elasticsearch inference endpoint. | Create an Elasticsearch inference endpoint. |
Create an ELSER inference endpoint. | Create an ELSER inference endpoint. |
Create an Google AI Studio inference endpoint. | Create an Google AI Studio inference endpoint. |
Create a Google Vertex AI inference endpoint. | Create a Google Vertex AI inference endpoint. |
Create a Hugging Face inference endpoint. | Create a Hugging Face inference endpoint. |
Create an JinaAI inference endpoint. | Create an JinaAI inference endpoint. |
Create a Mistral inference endpoint. | Create a Mistral inference endpoint. |
Create an OpenAI inference endpoint. | Create an OpenAI inference endpoint. |
Create a VoyageAI inference endpoint. | Create a VoyageAI inference endpoint. |
Create a Watsonx inference endpoint. | Create a Watsonx inference endpoint. |
Perform reranking inference on the service | Perform reranking inference on the service |
Perform sparse embedding inference on the service | Perform sparse embedding inference on the service |
Perform streaming inference. | Perform streaming inference. |
Perform text embedding inference on the service | Perform text embedding inference on the service |
Update an inference endpoint. | Update an inference endpoint. |
Click to show internal directories.
Click to hide internal directories.