AllFeed, trending, and board
FeedLatest news
TrendingOpen source and releases
BoardBlogs and showcases
TagsBrowse by topic

#llm-serving

The latest AI and developer news about #llm-serving, with the original source and a short summary.

AI Briefing

Privacy Policy Terms of Service Contact About Sources RSS Support us

Feed
Trending
Tags
Settings

Recipe Released for Serving 320B GLM-5.3-Flash on Free Kaggle TPUs

·2026.09.18 07:00

Optimizing Gemma 4 Serving with vLLM on Amazon EKS: Cold Start Reduced from 428s to 226s

·2026.09.10 09:00

Cohere Releases Megakernel Engine for North Mini Code, Achieving Up to 1.41x Speedup Over vLLM

·2026.09.09 00:00

vLLM Publishes Performance Benchmarks for 5 Speculative Decoding Methods on AMD GPUs

·2026.09.07 18:00

Paddock Inference Engine Released as Open Source

·1·2026.09.04 18:00

Cerebras Serves Qwen 3.8 27B Model at 1,500 Tokens per Second

·2026.09.04 06:00

PickFreeToken Serves 284B MoE Model on RTX 5090

·1·2026.08.25 12:00

FreeToken Enables High-Speed Execution of 290B MoE Models on Local PCs

·1·2026.08.22 12:00

LLM Serving: The Difference Between Launching and Launching Well

·1·2026.08.21 10:00

Breaking Through DeepSeek-V4-Pro Serving Limits

·2026.08.20 09:00

llama.cpp Proposes Dynamic MTP Optimization Feature

·1·2026.08.18 03:00

PyTorch Foundation Announces Updates on 6 Major Projects

·2026.07.24 19:00

PickNetflix's In-House LLM Serving Infrastructure

·1·2026.07.18 06:00

llama.cpp, sm-tensor Performance Optimization Patch

·2026.07.12 08:00

ELDR Routing Technique Reduces MoE Serving Latency

·2026.07.03 23:00

Agent-Based Development Approach for SGLang

·2026.07.03 09:00

Instantly Spin Up a vLLM Server with Hugging Face Jobs

·1·2026.06.26 05:00

Distributed AI Inference Speed Improved 15x

·1·2026.06.20 19:00

Xiaomi Unveils MiMo V2.5Pro

·2026.06.14 21:00

Kubernetes-based LLM Serving Optimization Technology

·1·2026.06.11 11:00

Apple Unveils MLX LM Server

·2026.06.09 09:00

Luce Spark Released, Running a 35B MoE on a 16GB GPU

·2026.06.09 00:00

1.58-bit BitCPM4-CANN released

·2026.05.18 20:00

TurboQuant Accuracy and Performance Evaluation

·2026.05.15 05:00

1
2
3
Next

1
2
3
Next

#llm-serving | AI Briefing