#small-language-models
The latest AI and developer news about #small-language-models, with the original source and a short summary.
The latest AI and developer news about #small-language-models, with the original source and a short summary.
China's open-source AI ecosystem is evolving through MoE architecture, multimodal expansion, and small model optimization.
AI21 has released Jamba Reasoning 3B, a 3B-class on-device open-source reasoning model.
WRITER has released the Palmyra-mini lineup, a set of lightweight, reasoning-focused models ranging from 1.5B to 1.7B parameters.
HuggingFace has unveiled SmolLM3, which delivers outstanding performance at the 3B scale and supports a 128k long context.
For enterprise AI, system design and product fit matter more than the LLM alone.
HuggingFace released the SmolLM series of small language models in 135M, 360M, and 1.7B sizes, trained on high-quality data.