You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When trying to load Velvet-14B model and tokenizer an error is raised.
Similarly to mistral models, the chat_template doesn't have a add_generation_prompt.
Traceback (most recent call last):
File "/u01/SUPPORT/test_unsloth/test_unsloth_velvet.py", line 4, in
model, tokenizer = FastLanguageModel.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/velvet/anaconda3/envs/unsloth/lib/python3.11/site-packages/unsloth/models/loader.py", line 258, in from_pretrained
model, tokenizer = dispatch_model.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/velvet/anaconda3/envs/unsloth/lib/python3.11/site-packages/unsloth/models/mistral.py", line 348, in from_pretrained
return FastLlamaModel.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/velvet/anaconda3/envs/unsloth/lib/python3.11/site-packages/unsloth/models/llama.py", line 1709, in from_pretrained
tokenizer = load_correct_tokenizer(
^^^^^^^^^^^^^^^^^^^^^^^
File "/home/velvet/anaconda3/envs/unsloth/lib/python3.11/site-packages/unsloth/tokenizer_utils.py", line 589, in load_correct_tokenizer
chat_template = fix_chat_template(tokenizer)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/velvet/anaconda3/envs/unsloth/lib/python3.11/site-packages/unsloth/tokenizer_utils.py", line 692, in fix_chat_template
raise RuntimeError(
RuntimeError: Unsloth: The tokenizer Almawave/Velvet-14B
does not have a {% if add_generation_prompt %} for generation purposes.
Please file a bug report immediately - thanks!
Script:
from transformers import TextStreamer
from unsloth import FastLanguageModel
When trying to load Velvet-14B model and tokenizer an error is raised.
Similarly to mistral models, the chat_template doesn't have a add_generation_prompt.
Script:
Python version: 3.11.11
with unsloth==2025.1.8 and unsloth_zoo==2025.1.4
The text was updated successfully, but these errors were encountered: