AI Briefing
KO

vLLM Adds Support for Mistral 3.5

·2026.04.29 05:00

Key point

A vLLM PR has added support code for Mistral-Medium 3.5 128B.

Details

In vLLM PR #41024, merged on April 28, 2026, support for EagleMistralForCausalLM was added.

  • New entries for mistralai/Mistral-Medium-3.5-128B and mistralai/Mistral-Medium-3.5-128B-EAGLE were registered in tests/models/registry.py.
  • These entries were registered with is_available_online=False.
  • The new file vllm/model_executor/models/mistral_eagle.py defines EagleMistralModel, EagleMistralDecoderLayer, and EagleMistralForCausalLM, implementing a speculative decoding path for the Mistral family.
  • The same PR also included Mistral-Large-3-675B-Instruct-2512 and its EAGLE variant.
inferencevllmmistral-3.5
Read originalShare on Threads

This summary was generated automatically by AI. Check the original for the author's claims and context. Copyright belongs to the original author.

Our guide explains how the AI works. Report summary errors, attribution issues, or removal requests via Contact.

Related

Hacker NewsDFlash 2: Maintaining Parallel DraftingRedditvLLM KV Cache Faces Cerebras Compatibility IssuesRedditOpen-Weight CLM Released as Jev Alternative, Agent Decision-Making 4x FasterPyTorchKRvLLM Introduces Hardware-Agnostic Layer Architecture to Support Diverse AcceleratorsPyTorchKRvLLM rope_scaling Override Causes 36% Model Configuration MismatchHacker NewsQwen3.5-based Small Decision Model 'Kev' Released with TypeSafe API Compatibility and Performance Metrics