Search results

tensorrt not running

Status: Open.

#3296 In huggingface/text-generation-inference;

·MohannadEhabBarakat openedon Jul 16, 2025

OpenTelemetry support for http endpoints

Status: Open.

#3295 In huggingface/text-generation-inference;

·simingy openedon Jul 15, 2025

PermissionError: [Errno 13] Permission denied: '/data' when deploying TGI on Hugging Face Spaces

Status: Open.

#3294 In huggingface/text-generation-inference;

·tarasariya-uttam openedon Jul 10, 2025

Vision encoder warmup fails with CPU vs CUDA mismatch (F.linear() input_tensor on CPU, weight on CUDA)

Status: Open.

#3293 In huggingface/text-generation-inference;

·adammpkins openedon Jul 8, 2025

How to detect watermark?

Status: Open.

#3289 In huggingface/text-generation-inference;

·Allencheng97 openedon Jul 7, 2025

Error when launching Magistral-Small-2506

Status: Open.

#3285 In huggingface/text-generation-inference;

·RonaldGalea openedon Jul 4, 2025

Models no more supported with neuron backend in optimum-neuron 0.2.0

Status: Open.

#3279 In huggingface/text-generation-inference;

·sebv004 openedon Jun 26, 2025

Rubbish responses by Llama-3.3-70B-Instruct when message API is enabled.

Status: Open.

#3277 In huggingface/text-generation-inference;

·alexshtf openedon Jun 26, 2025

New metric <code>tgi_kv_cache_usage</code>

Status: Open.

#3275 In huggingface/text-generation-inference;

·zhengkezhou1 openedon Jun 23, 2025

Support for Falcon-H1 models

Status: Open.

#3272 In huggingface/text-generation-inference;

·alexshtf openedon Jun 18, 2025

Enable passing arguments to chat templates

Status: Open.

#3259 In huggingface/text-generation-inference;

·alexshtf openedon Jun 9, 2025

if use chat.completions, text+image inference return incorrect output because of template issue

Status: Open.

#3257 In huggingface/text-generation-inference;

·sywangyi openedon Jun 6, 2025