Chat template `.call`
#1
by
lozhnikov
- opened
Is it a bug ?
{{- "<|python_tag|>" + tool_call.name + ".call(" }}
that chat template has tool_call.name.call(...) in it, while the dataset uses tool_call(...)
The template is originally from Llama3.1-8B-Instruct, not supporting our function call format. If you want to use FC based on our model, we recommend you to replace the chat template with vllm official implementation: https://github.com/vllm-project/vllm/blob/main/examples/tool_chat_template_toolace.jinja.