問題を報告する
このページは、まだ日本語ではご利用いただけません。翻訳中です。
Variable syntax
Currently, only double-curly-brace style ({{ }}) string placeholders are supported.
For example, in the template, define the prompt and the variable:
- name: sample-template
template: "Explain to me what {{thing}} is."
The template call from the consumer would contain a map of the variables to fill in, and must look like:
{
"prompt": "{template://sample-template}",
"properties": {
"thing": "gravity"
}
}
Allowing un-templated requests
Enable config option config.allow_untemplated_requests to allow consumers to continue to call the LLM, even when an explicit template
hasn’t been referenced in their request.
Examples
llm/v1/chat
{
"messages": "{template://developer-chat}",
"properties": {
"language": "python",
"program": "flask web server"
}
}
llm/v1/completions (‘Prompt’)
{
"prompt": "{template://developer-prompt}",
"properties": {
"language": "python",
"program": "flask web server"
}
}
Based on the following plugin configuration, where program and language are defined as template variables:
plugins:
- name: ai-prompt-template
config:
allow_untemplated_requests: true
templates:
- name: "developer-chat"
template: |-
{
"messages": [
{
"role": "system",
"content": "You are a {{program}} expert, in {{language}} programming language."
},
{
"role": "user",
"content": "Write me a {{program}} program."
}
]
}
- name: "developer-prompt"
template: |-
{
"prompt": "You are a {{language}} programming language expert. Write me a {{program}} program."
}