Qwen2_VL_(7B)-Vision.ipynb doesn't work

[shaform]

Hi,

I am trying to run the notebook: https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen2_VL_(7B)-Vision.ipynb.

I simply click Runtime -> Run all, but the model cannot be finetune successfully, it would just output a lot of systemsystemsystemsystemsystem. This is different from the original output in the notebook!

Is this expected or are there some bugs!?

[lunzima]

Hi,

I'm encountering the same issue when running the notebook: https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen2_VL_(7B)-Vision.ipynb. The model fails to fine-tune successfully, and instead of the expected output, it produces a lot of repeated text.

I believe this is likely due to an issue with unsloth's implementation rather than any problem with the notebook file itself.
I have created an issue on GitHub: unslothai/unsloth#2120

Best regards,
Lunzima