AI Briefing#llm-performance
The latest AI and developer news about #llm-performance, with the original source and a short summary.
The latest AI and developer news about #llm-performance, with the original source and a short summary.
The compiler uses persistent engines to reduce startup time from 467 seconds to 9.0 seconds, enabling real-time adaptation to traffic and hardware changes.
Zhipu is quietly testing GLM-5.3-Highspeed in a gray release for ZCode subscribers, with users reporting speeds of approximately 490 tokens per second.
Analysis reveals that actual reasoning token usage in Claude models is significantly lower than benchmark levels, creating an 'Inference Gap' and prompting calls for transparency and regulatory discussions.
Inception Labs has released Mercury 2.5, which increases intelligence by 40% and generates 1,107 tokens per second.
By enabling two API settings, GPT-5.6's ARC-AGI-3 performance and efficiency were maximized.
Running an agent multiple times and combining the results can be more efficient than improving the model itself.
This analyzes the queue-blocking problem caused by long prompts in vLLM's chunked-prefill strategy and presents an optimization approach.
Artificial Analysis has introduced an LLM performance leaderboard on Hugging Face that comprehensively evaluates price, speed, and quality.