Does this model support tool calling?

by Amirjab21 - opened 17 days ago

I tried to add the ability to do a function call to allow this model to be used in a voice agent which can call a knowledge base.

It works occasionally but am finding it difficult to get it to behave like other LLMs - Any advice on this? Do I need to do a bit of finetuning to add this ability?

alexrs

Cohere Labs org 17 days ago

Hey @Amirjab21

The model does not support tool calling by default, but can be fine-tuned to add this capability. @sergiopaniego shared a detailed example! -- https://x.com/SergioPaniego/status/2024170215727157531

Notebook: https://colab.research.google.com/github/huggingface/trl/blob/main/examples/notebooks/sft_tool_calling.ipynb
Script: https://github.com/huggingface/trl/blob/main/examples/scripts/sft_tiny_aya_tool_calling.py

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment