#llm
The latest AI and developer news about #llm, with the original source and a short summary.
The latest AI and developer news about #llm, with the original source and a short summary.
PORTool improved both accuracy and tool-call efficiency together through step-wise importance estimation.
LLM inference splits into prefill and decode, and the KV cache determines speed.
Russia is attempting information manipulation by spreading pro-Kremlin narratives targeting Wikipedia and AI tools.
Defined the harness of LLM development tools and proposed a regression testing tool.
CAISI evaluated DeepSeek V4 and found it to be China's top model, but about 8 months behind the US frontier.
The Blender MCP server executes LLM-generated code without safeguards, raising the risk of data leaks.
It explains that schema validation raised the CoT compliance rate from 9.91% to 100%.
An 826,985-parameter Transformer built in C++17 achieved a validation loss of 1.6371 after training for 76.2 minutes on a single CPU core.
CAJAL-4B-P2PCLAW has released a 4.21B parameter model specialized for distributed systems.
The analysis examines the differing effects of increasing LLM parameters on reasoning ability versus the acquisition of factual knowledge.
In a 30-day Bitcoin prediction benchmark, Perplexity ranked first.
MiniMax M2.7 AWQ-4bit was compared for performance and energy efficiency on 2x Spark and 2x RTX 6000 96GB.
Unsloth released a fixed version of the Mistral Medium 3.5 128B GGUF model that had been producing errors in long contexts.
An open-source financial analysis platform supporting 37 AI agents and multiple LLMs has been released.
Netflix routed model serving traffic by purpose using Switchboard.
Seven AI companies, including OpenAI, Google, and Microsoft, have been approved to deploy tools on the Pentagon's classified network.
Thoth v3.19.0 has been released, supporting a multi-provider runtime including OpenAI, Anthropic, and more.
Mistral is differentiating itself from OpenAI by targeting European enterprise and public-sector markets through data sovereignty and an open-weight strategy.
GitHub Copilot is switching to token-based billing and has sharply raised the pricing multipliers for top-tier models.
Released a Claude skill that turns URLs into a citable LLM Wiki.
This analyzes why the Zig project bans LLM use and focuses on contributor growth.
Applying Speculative Decoding to NeMo-RL boosted RL rollouts by 1.8x.
Andrew Kelley said LLM-assisted PRs are easily distinguished from human mistakes.
On LoCoMo, the local 20B model dropped only about 4 points after 1,100 poisoned memories were injected.