Movatterモバイル変換

[0]ホーム
URL:

Skip to main content
Optimization
Evaluations
  • Overview
Gateway

How to create a prompt template

Learn how to use prompt templates and schemas to manage complexity in your prompts.

Why create a prompt template?

Prompt templates and schemas simplify engineering iteration, experimentation, and optimization, especially as application complexity and team size grow.Notably, they enable you to:
  1. Decouple prompts from application code.As you iterate on your prompts over time (orA/B test different prompts), you’ll be able to manage them in a centralized way without making changes to the application code.
  2. Collect a structured inference dataset.Imagine down the road you want tofine-tune a model using your historical data.If you had only stored prompts as strings, you’d be stuck with the outdated prompts that were actually used at inference time.However, if you had access to the input variables in a structured dataset, you’d easily be able to counterfactually swap new prompts into your training data before fine-tuning.This is particularly important when experimenting with new models, because prompts don’t always translate well between them.
  3. Implement model-specific prompts.We often find that the best prompt for one model is different from the best prompt for another.As you try out different models, you’ll need to be able to independently vary the prompt and the model and try different combinations thereof.This is commonly challenging to implement in application code, but trivial in TensorZero.
You can also find a complete runnable example for this guide onGitHub.

Set up a prompt template

1

Create your template

Create a file with your MiniJinja template:
config/functions/fun_fact/gpt_5_mini/fun_fact_topic_template.minijinja
Share a fun fact about: {{ topic }}
TensorZero uses theMiniJinja templating language.MiniJinja ismostly compatible with Jinja2, which is used by many popular projects like Flask and Django.
MiniJinja provides abrowser playground where you can test your templates.
2

Configure a template

Next, you must declare the template in thevariant configuration.You can do this by adding the fieldtemplates.your_template_name.path to your variant with a path to your template file.For example, let’s configure a template calledfun_fact_topic for our variant:
config/tensorzero.toml
[functions.fun_fact]type ="chat"[functions.fun_fact.variants.gpt_5_mini]type ="chat_completion"model ="openai::gpt-5-mini"templates.fun_fact_topic.path ="functions/fun_fact/gpt_5_mini/fun_fact_topic_template.minijinja" # relative to this file
You can configure multiple templates for a variant.
3

Use your template during inference

  • Python
  • Python (OpenAI SDK)
  • HTTP
Use your template during inference by sending a content block with the template name and arguments.
result= t0.inference(    function_name="fun_fact",    input={        "messages": [            {                "role":"user",                "content": [                    {                        "type":"template",                        "name":"fun_fact_topic",                        "arguments": {"topic":"artificial intelligence"},                    }                ],            }        ],    },)
Use your template during inference by sending atensorzero::template content block with the template name and arguments.
result= client.chat.completions.create(    model="tensorzero::function_name::fun_fact",    messages=[        {            "role":"user",            "content": [                {                    "type":"tensorzero::template",# type: ignore                    "name":"fun_fact_topic",                    "arguments": {"topic":"artificial intelligence"},                }            ],        },    ],)
Use your template during inference by sending atemplate content block with the template name and arguments.
curl -X POST http://localhost:3000/inference \  -H "Content-Type: application/json" \  -d '{    "function_name": "fun_fact",    "input": {      "messages": [        {          "role": "user",          "content": [            {              "type": "template",              "name": "fun_fact_topic",              "arguments": {                "topic": "artificial intelligence"              }            }          ]        }      ]    }  }'

Set up a template schema

When you have multiple variants for a function, it becomes challenging to ensure all templates use consistent variable names and types.Schemas solve this by defining a contract that validates template variables and catches configuration errors before they reach production.Defining a schema is optional but recommended.
1

Create a schema

Create aJSON Schema for the variables used by your templates.Let’s define a schema for our previous example, which includes only a single variabletopic:
config/functions/fun_fact/fun_fact_topic_schema.json
{  "$schema":"http://json-schema.org/draft-07/schema#",  "type":"object",  "properties": {    "topic": {      "type":"string"    }  },  "required": ["topic"],  "additionalProperties":false}
LLMs are great at generating JSON Schemas.For example, the schema above was generated with the following request:
Generate a JSON schema with a single field: `topic`.The `topic` field is required. No additional fields are allowed.
You can also export JSON Schemas fromPydantic models andZod schemas.
2

Configure a schema

Then, declare your schema in your function definition usingschemas.your_schema_name.path.This will ensure that every variant for the function has a template namedyour_schema_name.In our example above, this would mean updating the function definition to:
[functions.fun_fact]type ="chat"schemas.fun_fact_topic.path ="functions/fun_fact/fun_fact_topic_schema.json" # relative to this file[functions.fun_fact.variants.gpt_5_mini]type ="chat_completion"model ="openai::gpt-5-mini"templates.fun_fact_topic.path ="functions/fun_fact/gpt_5_mini/fun_fact_topic_template.minijinja" # relative to this file

Re-use prompt snippets

You can enable template file system access to reuse shared snippets in your prompts.To use the MiniJinja directives{% include %} and{% import %}, setgateway.template_filesystem_access.base_path in your configuration.SeeOrganize your configuration for details.

Migrate from legacy prompt templates

In earlier versions of TensorZero, prompt templates were defined assystem_template,user_template, andassistant_template.Similarly, template schemas were defined assystem_schema,user_schema, andassistant_schema.This legacy approach limited the flexibility of prompt templates restricting the ability to define multiple templates per role.As you create new functions and templates, you should use the newtemplates.your_template_name.path format.Historical observability data stored in your ClickHouse database still uses the legacy format.If you want to keep this data forward-compatible (e.g. for fine-tuning), you can update your configuration as follows:
Legacy ConfigurationUpdated Configuration
system_templatetemplates.system.path
system_schemaschemas.system.path
user_templatetemplates.user.path
user_schemaschemas.user.path
assistant_templatetemplates.assistant.path
assistant_schemaschemas.assistant.path
As we deprecate the legacy format, TensorZero will automatically look for templates and schemas in the new format for your historical data.
⌘I
[8]ページ先頭
©2009-2025 Movatter.jp