AllFeed, trending, and board
FeedLatest news
TrendingOpen source and releases
BoardBlogs and showcases
TagsBrowse by topic

#llm-inference

The latest AI and developer news about #llm-inference, with the original source and a short summary.

AI Briefing

Privacy Policy Terms of Service Contact About Sources RSS Support us

Feed
Trending
Tags
Settings

Community Template Fix Corrects GPT-OSS Bug That Dropped Answers in Multi-Turn Chats

·2026.09.27 05:00

vLLM Introduces Hardware-Agnostic Layer Architecture to Support Diverse Accelerators

·1·2026.09.25 19:00

vLLM rope_scaling Override Causes 36% Model Configuration Mismatch

·2026.09.25 17:00

TextCLF Releases Calibration-Free TQ Quantization Method and Open-Source Quant Factory

·2026.09.25 07:00

PickUnderdog Releases 'Husky', a Model-Specific Inference Engine Up to 4.5x Faster than MLX

·2026.09.23 09:00

Inco AI Releases Splash, an Inference Engine Dedicated to Apple Silicon

·2026.09.20 11:00

Comparison of Features and Use Cases for 8 LLM Inference Stacks

·2026.09.19 01:00

GraphSignal GPU Profiler for AI Agents Released

·2026.09.17 21:00

Intel Releases OpenVINO 2026.4

·1·2026.09.17 18:00

Single-File C Engine for Gemma Multimodal Inference Released

·2026.09.16 19:00

Edge0 Runs 35B MoE Model on 3GiB Memory via SSD Streaming

·2026.09.15 08:00

Micron Addresses Memory Bottlenecks at Hot Chips; Samsung PIM Speeds Up LLM Inference by 3x

·2026.09.14 11:00

LLMTraceFX Introduces Independent Auditor to Verify That Cache Hits Do Not Prove Computation Omission

·1·2026.09.13 15:00

PickNVIDIA Open-Sources Local AI Inference Router 'PAIR'

·2·2026.09.13 09:00

PickGap Confirmed Between RTK's Claimed Token Savings and Actual Cost Benchmarks

·3·2026.09.11 17:00

Nvidia Releases 'SoL-Pi' Extension to Optimize Pi Agent Efficiency

·2026.09.11 05:00

KV Cache Research: Limitations of LRU Alternatives and Failure in Capacity-bound Environments

·2026.09.10 22:00

KV Cache as an Agent Runtime [R]

·2026.09.07 18:00

Salesforce Releases 'Random Attention' KV Cache Eviction Policy for Reasoning Models

·2026.09.07 09:00

NInfer Fork Released: Supports 555k Context on RTX 5090 with NVFP4 KV Cache and YARN

·2026.09.06 07:00

eLLM Reveals CPU Inference Performance

·2026.09.04 21:00

Cerebras Model Catalog (Website)

·2026.09.04 09:00

ik_llama.cpp Merges Qwen3.8 MTP Support

·2026.09.04 01:00

3.85x Inference Speedup via Diffusion Draft Generation and AR Verification Based on GLM-OCR

·1·2026.09.03 18:00

1
2
3
4
5
Next

1
2
3
4
5
6
7
8
9
Next

#llm-inference | AI Briefing