You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Good question - I think we'll need to add this in.
For Gemma it's:
<start_of_turn>user
knock knock<end_of_turn>
<start_of_turn>model
who is there<end_of_turn>
<start_of_turn>user
Gemma<end_of_turn>
<start_of_turn>model
Gemma who?<end_of_turn>
For Phi-3.5 it's:
"chat_template": "{% for message in messages %}{% if message['role'] == 'system' and message['content'] %}{{'<|system|>\n' + message['content'] + '<|end|>\n'}}{% elif message['role'] == 'user' %}{{'<|user|>\n' + message['content'] + '<|end|>\n'}}{% elif message['role'] == 'assistant' %}{{'<|assistant|>\n' + message['content'] + '<|end|>\n'}}{% endif %}{% endfor %}{% if add_generation_prompt %}{{ '<|assistant|>\n' }}{% else %}{{ eos_token }}{% endif %}",
I've tried looking around for the keys to use for the
get_chat_template
function but I can't figure out some of the models' keys.From https://github.com/unslothai/unsloth/blob/main/unsloth/chat_templates.py
unsloth/Qwen2.5-*
models maps totokenizer = get_chat_template(tokenizer, chat_template = "qwen25")
unsloth/[Mm]istral*
models maps totokenizer = get_chat_template(tokenizer, chat_template = "mistral")
unsloth/*[Ll]lama*
models maps totokenizer = get_chat_template(tokenizer, chat_template = "llama")
How about these, what should be the key to fetch the chat templates?
unsloth/gemma*
unsloth/Phi-3*
The text was updated successfully, but these errors were encountered: