[FIXED] 'MistralConfig' is not defined

[ArnoBen]

Greetings,

I've been trying to run the Mistral_v0.3_(7B)-Conversational notebook on my own server.
I followed the notebook cells and was hit with NameError: name 'MistralConfig' is not defined, from this file:
unsloth/models/mistral.py, Line 310
even though from transformers import MistralConfig works fine.

Since it's running fine on Colab's server, I checked the package versions and noticed that Colab had transformers==4.47.1 whereas I was running 4.48.0.

Downgrading to 4.47.1 fixed the issue but this will currently break when simply pip-installing unsloth calling the method with a Mistral model.

[InshaManowar]

Traceback (most recent call last): File "/opt/conda/lib/python3.11/site-packages/unsloth/models/llama.py", line 1610, in from_pretrained model_patcher.pre_patch() File "/opt/conda/lib/python3.11/site-packages/unsloth/models/mistral.py", line 310, in pre_patch exec(function, globals()) File "<string>", line 1, in <module> NameError: name 'MistralConfig' is not defined

Got the same error, but downgrading transformer to 4.47.1 worked.

[danielhanchen]

Apologies on the delay - working on a fix as we speak!

[vivirox]

Just to add in -- another confirm that downgrading transformers to 4.47.1 works.

[danielhanchen]

Yes downgrading is the best solution for now - apologies it's more complicated than I expected :( I expect the solution to be in Unsloth by tomorrow - apologies on the delay!

[danielhanchen]

@ArnoBen @InshaManowar @vivirox It should be fixed now - apologies on the wait! Please update Unsloth for local machines via:

pip install --upgrade --force-reinstall --no-cache-dir --no-deps unsloth unsloth_zoo

[ArnoBen]

Amazing, I confirm it works on my end. Thank you very much !