#fp4
The latest AI and developer news about #fp4, with the original source and a short summary.
The latest AI and developer news about #fp4, with the original source and a short summary.
The official DeepSeek V4 paper has been released, adding FP4 QAT and stabilization techniques.
The Dell Pro Max GB10 ran a 70B-class LLM locally in real time using 128GB of unified memory.
Different FP4 inference support has been added to llama.cpp and ik_llama.cpp.
On 4x Tesla M40 12GB with an fp4 setup, Qwen3.6 27B speed was reported at 26 tok/s PP and 8 tok/s TG.
Explains the bit composition, value range, and E2M1 format of FP4.
DeepSeek has updated DeepGEMM with Blackwell optimizations and Mega MoE support.
NVIDIA Sol-RL reduces cost and accelerates convergence by separating FP4 rollouts from BF16 updates.