AI Briefing#model-quantization
The latest AI and developer news about #model-quantization, with the original source and a short summary.
The latest AI and developer news about #model-quantization, with the original source and a short summary.
The new quantized models achieve near-BF16 performance at 3.50 bpw, while the expert-pruned Coder build reduces the resident working set to 29.6 GB.
Aikido has released Altar, a lightweight open-weight security model that runs in on-premises environments without leaking sensitive security data.
Cerebras offers GPT OSS and Qwen 3.8 models on public endpoints, specifying that all models are original, non-pruned versions.
A 2-bit Qwen3.6-35B-A3B model and a dedicated runtime have been released, dramatically reducing size while maintaining FP8-level performance.
PrismML has released Bonsai 27B, a model that compresses Qwen 3.6-27B down to 3.9GB via 1-bit quantization.
A compact 1-bit and ternary Bonsai Image 4B model has been released, enabling high-quality image generation on local devices.
Falcon-Edge, a series of 1.58-bit language models in 1B and 3B scales based on the BitNet architecture, has been released.