#efficiency
The latest AI and developer news about #efficiency, with the original source and a short summary.
The latest AI and developer news about #efficiency, with the original source and a short summary.
The open-weight model achieves a 13.7s median response time versus 28.1s for the base model while maintaining comparable accuracy on five benchmarks.
The 4B model uses 13.0% fewer model calls and 25.4% fewer output tokens than comparable systems after online RL.
Presented at EMNLP 2026, the method reuses key-value buffers from earlier layers to mitigate representation collapse in ~1B parameter models.
A roundup of 10 latest AI/ML papers addressing agent efficiency and MCP governance issues.
The method uses pair-norm analysis to allocate precision to salient channel pairs, maintaining accuracy down to 1.5 bits where baselines degrade sharply.
The new Sabi-Noema models reduce token generation by 50% on TB2.1 while outperforming GPT 6 Luna-medium on DeepSWE benchmarks.
Applying the wake-sleep algorithm to long-horizon legal agents increased the all-pass rate from 2.9% to 15.7% and halved the cost per task through selective memory retrieval.
The new Swift 1.5 27B model reduces thinking tokens by 58.5% while improving accuracy, with Flash Next offering a 1.8x speed increase.
Parallel reduced research time and costs by 50% and improved efficiency by adopting GPT-6 Astra.
Magic announced that a new pretraining recipe reached performance similar to DeepSeek V4 Pro Base with approximately 50x fewer FLOPs, and that training scaled up by approximately 10x subsequently outperformed public base models in perplexity evaluations.
A tool called 'Web Draw' has been released, enabling web automation using 7B-class text models without vision models.
Dropbox is pursuing a strategy to optimize existing infrastructure from a systems perspective and maximize efficiency to address the surge in AI demand.
A new attention mechanism called SSOG has been released, improving SDPA's $O(N^2)$ complexity to $O(N\sqrt{N})$.
Through low-cost RL fine-tuning, a 9B-scale open model outperformed high-performance models on specific domain performance.
A new technique is proposed that compresses narrative portions of the reasoning process while preserving only the computation/verification segments, reducing tokens while maintaining performance.
The Pulpie model has been released, revolutionizing data quality and cost by efficiently extracting only the main content from HTML pages.
The study found that training only a specific intermediate layer during RL training can achieve performance similar to full-parameter training.
LiteFrame is a lightweight vision encoder that cuts Video LLM inference latency by 35% and enables long-form video understanding.
AllenAI released the remote sensing model OlmoEarth v1.1, cutting compute costs by up to 3x.
By applying a caching technique that computes long prompts only once during RL training, training efficiency was significantly improved.
SATFormer is proposed, improving efficiency by selectively reusing early-layer representations on a per-token and per-head basis.
Meta's internal token leaderboard revealed 60 trillion tokens used in 30 days and the flaws in the metric.
It presented the causes and code-based solutions for four major bugs, including scroll position, Z-axis rendering, and touch events.
We introduce Nyströmformer, which uses the Nyström method to reduce the complexity of Transformer's self-attention from $O(n^2)$ to $O(n)$.