AI BriefingReddit news
The latest AI and developer news from Reddit, with short summaries.
Visit website →llama.cpp Improves Inference Speed with CUDA-based FWHT
A CUDA-based FWHT has been added to llama.cpp, improving inference speed when using KV-cache quantization.
Anthropic preparing new model 'Mythos 1'
Anthropic's new model 'Mythos 1' appears set to be introduced into Claude Code and Claude Security.
llama.cpp to fix multi-GPU crash
A patch is being prepared in llama.cpp to fix VRAM exhaustion and crash issues in Split Mode Tensor when using multiple GPUs.
Delta Attention Residuals Technique Unveiled
Delta Attention Residuals has been unveiled, boosting LLM performance by solving the routing collapse problem of existing residual connections.
MCP Launched to Track Citation URLs Across AI Engines
An open-source MCP server has been released that tracks citation URLs from major AI engines like Claude and ChatGPT, and compares them with Google Search Console data.
RTPurbo: Converting Full Attention into Sparse
RTPurbo, a technique that converts a Full Attention LLM into a highly efficient Sparse model with only a few hundred short training steps, has been unveiled.
Llama 3.3 Guardrails Removed in 10 Minutes
The Financial Times reported on 'Heretic,' a tool that can remove Llama 3.3's guardrails in just 10 minutes.
NuExtract3: 4B VLM for Document Extraction Released
NuExtract3, a VLM based on Qwen3.5-4B specialized for document data extraction and Markdown conversion, has been released.
Anthropic Pushes Forward Secret Surveillance Tool Contract with NSA
Anthropic is finalizing a classified contract with the NSA to provide secret surveillance tools.
2-bit KV Cache Quantization Technique 'OSCAR' Released
A 2-bit quantization technique has been released that compresses KV cache memory usage by about 7x while minimizing performance degradation.
Agent-based legal system 'Lavern' released
Lavern, an open-source agent-based legal system featuring 67 specialist agents, has been released.
NuExtract3: Document Extraction and Conversion Model
NuExtract3, a 4B-scale vision-language model specialized in document understanding and structured information extraction, has been released.
Grok Teases 0.5T-Scale Model Launch
Elon Musk announced that a Grok model with 0.5T parameters will be released next year.
W8A8 Quantization SDK 'Cider' for MLX Released
The SDK 'Cider,' which supports W8A8 activation quantization on Apple Silicon by addressing MLX's limitations, has been released.
llama.cpp Optimizes Context Re-processing
A checkpoint feature has been proposed to solve the problem of reprocessing the entire prompt whenever the context changes in llama.cpp.
UC Berkeley School of Law Bans AI Use Entirely
UC Berkeley School of Law will ban AI use for most assignments starting summer 2026 to cultivate critical thinking.
Starbucks Scraps Automated Inventory Management AI
Starbucks scrapped its automated inventory management AI program just nine months after launch due to the limitations of computer vision technology.
Google AI Search Surpasses 2.5 Billion Users
Google's AI Overviews has reached 2.5 billion users, driving a fundamental shift in the search ecosystem.
OpenAI Posts $6.95B Loss in Q1
OpenAI recorded a massive operating loss in Q1, spending $1.22 for every $1 of revenue.
California Issues Executive Order to Protect AI Jobs
California has announced the first executive order in the United States to address worker job losses caused by AI adoption.