AllFeed, trending, and board
FeedLatest news
TrendingOpen source and releases
BoardBlogs and showcases
TagsBrowse by topic

#gpu-inference

The latest AI and developer news about #gpu-inference, with the original source and a short summary.

AI Briefing

Privacy Policy Terms of Service Contact About Sources RSS Support us

Feed
Trending
Tags
Settings

PickNetflix's In-House LLM Serving Infrastructure

·1·2026.07.18 06:00

llama.cpp Adds MTP Support

·2026.05.19 04:00

Qwen3.6 27B on Dual RTX 5060 Ti, 60 tok/s

·2026.04.29 17:00

22 tok/s on RTX 5060 Ti 16GB

·2026.04.24 09:00

85TPS on a single 3090

·2026.04.23 23:00

Zero-Copy GPU Inference with WebAssembly on Apple Silicon

·2026.04.19 07:00

MIG cuts p95 in half

·2026.04.18 04:00

40 tok/s on a 3080

·2026.04.17 05:00

2x Speed with WSL

·2026.04.16 11:00

122B 198t/s

·2026.04.10 09:00

Beyond Two-Tower: Redesigning the Serving Stack for Next-Generation Lightweight Ad Ranking Models

·2026.02.03 02:00

#gpu-inference | AI Briefing