Mistral 3.5 Inference Bug Fixed
·2026.05.02 16:13
Key point
Unsloth fixed the Mistral Medium 3.5 inference bug and updated the GGUF.
Details
In the May 1, 2026 update, Unsloth announced that, together with Mistral, it fixed an inference issue with Mistral Medium 3.5.
The problem was not with Unsloth's quantization but a YaRN parsing quirk, which affected multiple implementations including transformers and llama.cpp.
The fix details are as follows.
- Changing
mscale_all_dimfrom 1 → 0 resolves the issue. - A GGUF with the fix applied has been released.
- An error in mmproj file generation was also corrected at the same time.
This summary was generated automatically by AI. Check the original for the author's claims and context. Copyright belongs to the original author.
Our guide explains how the AI works. Report summary errors, attribution issues, or removal requests via Contact.