AI Briefing
KO

Mistral 3.5 Inference Bug Fixed

·2026.05.02 16:13

Key point

Unsloth fixed the Mistral Medium 3.5 inference bug and updated the GGUF.

Details

In the May 1, 2026 update, Unsloth announced that, together with Mistral, it fixed an inference issue with Mistral Medium 3.5.

The problem was not with Unsloth's quantization but a YaRN parsing quirk, which affected multiple implementations including transformers and llama.cpp.

The fix details are as follows.

  • Changing mscale_all_dim from 1 → 0 resolves the issue.
  • A GGUF with the fix applied has been released.
  • An error in mmproj file generation was also corrected at the same time.

This summary was generated automatically by AI. Check the original for the author's claims and context. Copyright belongs to the original author.

Our guide explains how the AI works. Report summary errors, attribution issues, or removal requests via Contact.