AI BriefingReddit news
The latest AI and developer news from Reddit, with short summaries.
Visit website →H100 3GB Savings
Unweight reduces LLM weights by 15-22%, freeing up about 3GB of VRAM on H100.
Novartis CEO Joins Anthropic's Board
The Novartis CEO has joined Anthropic's board of directors.
Chatbots' Political Party Recommendations Are Also Biased
Chatbots like ChatGPT and Gemini showed biased party recommendations in the context of a Danish election.
Free LLM API Updates
A roundup of free LLM APIs and limits from Cohere, Gemini, Mistral, and Z.AI.
KV cache down 35%
Compressed the KV cache on Qwen 3.6's 1M context, reducing it from 10.7GB to 6.9GB.
Cautions When Fine-Tuning and Deploying Gemma-4
This summarizes the major technical issues and solutions that arise during fine-tuning and deployment of the Gemma-4 model.
Copilot Auto-Selects Models
In Copilot CLI, auto automatically selects the most efficient model.
GHOST v2.1 Released
GHOST v2.1 adds native Windows support, simplifying running AI models on AMD GPUs.
Rosalind Deploys
OpenAI unveiled GPT-Rosalind, a specialized AI tool for life sciences research, targeting early-stage drug discovery.
ARM Local Inference Speed
Llama.cpp token speed measurements on the Zenbook A16 with Snapdragon X2 Elite Extreme.
Super-accelerating with 2x 3090
Ran Qwen3.6 35B 4bit for multi-user use via vLLM Docker on 2x RTX 3090.
AI Health Consultations Among Americans
1 in 4 US adults have sought health information via AI in the past 30 days.
Mythos Selectively Released
Anthropic has made Mythos Preview available only to Big Tech, security, infrastructure, and financial partners.
Workspace Experiment
CWT reduced compute by **about 45%** while maintaining a **PPL difference of 1.7%** versus the baseline.
Local Memory Evolves
Lore 0.2.0 is released with ThinkingStream and non-destructive embedding migration added.
Major Session Manager Overhaul
Clauge v2.0.0 has been released, adding a dashboard, plugins, and context management.
KV crosses the DC
Kimi Linear makes cross-datacenter Prefill/Decode disaggregation practical, lowering costs.
Anthropic Impersonation Site Found on Google
A site impersonating Anthropic, `claudcode.playcode.io`, appeared in Google search results.
Enterprise AI Trend: The Hybrid Model
The enterprise AI market is expected to grow rapidly through a hybrid approach that combines cloud and local systems for cost savings and security.