#qat
The latest AI and developer news about #qat, with the original source and a short summary.
The latest AI and developer news about #qat, with the original source and a short summary.
New NVFP4 and GGUF checkpoints use quantization-aware distillation to achieve lower KL divergence than reference 4-bit models from NVIDIA, Google, and community quantizers.
MTP heads for Gemma 4 QAT models have been released, along with news of a fix for a llama.cpp parallel execution bug.
Google has released Gemma 4 models with QAT technology applied to boost efficiency on mobile and laptop environments.