AI Briefing#ternary-bonsai
The latest AI and developer news about #ternary-bonsai, with the original source and a short summary.
The latest AI and developer news about #ternary-bonsai, with the original source and a short summary.
PrismML has released 'Ternary Bonsai 2 27B', a 27B multimodal LLM quantized to ternary values that maintains 98.2% of FP16 performance.
llama.cpp's ggml library has added Q2_0 quantization for CPU to support Ternary Bonsai models.
PrismML has released Ternary Bonsai, a family of 8B, 4B, and 1.7B LLMs using 1.58-bit ternary weights.