AllFeed, trending, and board
FeedLatest news
TrendingOpen source and releases
BoardBlogs and showcases
TagsBrowse by topic

#llm-inference

The latest AI and developer news about #llm-inference, with the original source and a short summary.

AI Briefing

Privacy Policy Terms of Service Contact About Sources RSS Support us

Feed
Trending
Tags
Settings

#llm-inference - page 6 | AI Briefing

DeepLearning.AI Launches Official vLLM Course

·2026.06.05 02:00

Speculative KV Coding: Losslessly Compressing the KV Cache by Up to ~4x

·2026.06.05 00:00

OCTOPUS: Optimizing Transformer KV Cache via Optimal Squared-Error Quantization and Octahedral Parameterization

·2026.06.04 01:00

llama.cpp adds reasoning level control feature

·1·2026.06.02 22:00

llama.cpp adds Step-3.7-Flash support

·2026.06.02 18:00

llama.cpp Proposes VRAM Usage Optimization PR

·2026.06.02 00:00

llama.cpp Adds Support for EXAONE 4.5

·2026.06.01 18:00

llama.cpp Unified Binary and Website

·2026.05.30 01:00

Real-Time LLM Inference on Standard GPUs: 3,000 tokens/s per Request

·2026.05.29 18:00

AMD MI300X LLM Inference Optimization Technology

·2026.05.29 17:00

llama.cpp Optimizes VRAM Usage for Flash Attention

·2026.05.29 16:00

llama.cpp AMD/ROCm Update

·1·2026.05.29 10:00

Zai Optimizes GLM-5.1 Inference Network

·1·2026.05.28 22:00

Zai Optimizes GLM-5.1 Inference with ZCube Adoption

·2026.05.28 22:00

GPU Job Scheduling Using an Idle Inference GPU Pool

·1·2026.05.27 08:00

TogetherAI Unveils OSCAR KV Quantization

·2026.05.26 21:00

2-bit KV Cache Quantization Technique 'OSCAR' Released

·2026.05.25 20:00

llama.cpp Optimizes Context Re-processing

·1·2026.05.25 15:00

AMD RDNA3-Optimized Inference Engine hipEngine

·2026.05.25 07:00

llama.cpp Asymmetric KV Cache Quantization Issue and Optimization Discussion

·3·2026.05.22 22:00

Mix-Quant: Quantize the Prefill, Keep the Decoding at High Precision

·2026.05.22 04:00

Open-Source GPU Observability Tool l9gpu Released

·2026.05.21 10:00

AWS Offers M3 Ultra Mac Studio

·2026.05.20 23:00

llama.cpp Improves Prompt Processing Speed for MTP

·2026.05.18 00:00

Previous
4
5
6
7
8
Next

Previous
1
2
3
4
5
6
7
8
9
Next