Function Calling
Hi, I am new here, and I don't understand how to use function calling in this mode. Any examples would be helpful.
Sorry, during multimodal training, we did not include function calling data. However, the Qwen2.5 LLM should support function calling, so you can try using the Qwen2.5 LLM approach.
Sorry, during multimodal training, we did not include function calling data. However, the Qwen2.5 LLM should support function calling, so you can try using the Qwen2.5 LLM approach.
What do you mean by "the Qwen2.5 LLM approach"? Simply just the tool calling options in the system prompt?
I have tried running inference with the model via vLLM and the "Hermes" tool parser, since the Qwen models use Nous Research's Hermes function-calling format and Qwen recommends using the Hermes tool parser for vLLM, but the model does not retain this capability. In short, you should not expect function-calling to work with the model even at 0 and near-0 temperatures.
It would be really cool to see a version or fine-tune of this model that also supports tool/function calling! The Nous team has open-sourced their function-calling data set, so this would be a really cool thing.