AllFeed, trending, and board
FeedLatest news
TrendingOpen source and releases
BoardBlogs and showcases
TagsBrowse by topic

#llm-inference

The latest AI and developer news about #llm-inference, with the original source and a short summary.

AI Briefing

Privacy Policy Terms of Service Contact About Sources RSS Support us

Feed
Trending
Tags
Settings

#llm-inference - page 7 | AI Briefing

llama.cpp b9180 Adds MTP Support

·2026.05.17 02:00

llama.cpp Adds MTP Support

·2026.05.16 21:00

What Does GGUF Contain Besides Weights, and What's Still Missing

·2026.05.16 16:00

Orthrus-Qwen3: Up to 7.8x tokens/forward on Qwen3, identical output distribution

·2026.05.16 07:00

Orthrus-Qwen3-8B 7.8x Speedup

·2026.05.16 04:00

Orthrus: Diffusion-based Parallel Token Generation Technique Unveiled

·2026.05.16 02:00

llama.cpp Releases Update with RDNA3 Flash Attention Fix

·2026.05.15 09:00

What Does GGUF Contain Beyond Weights, and What's Still Missing?

·2026.05.15 02:00

Asynchronizing continuous batching

·2026.05.15 00:00

Sipeed K3 Runs 30B LLM

·2026.05.14 00:00

Attention Drift Discovered

·2026.05.13 04:00

Luce DFlash Support for AMD Strix Halo

·2026.05.13 03:00

Rapid-MLX - Ultra-Fast Local AI Engine Exclusively for Apple Silicon

·2026.05.12 09:00

ExLlamaV3 Major Update

·2026.05.11 16:00

AI Accelerator Emerges That Runs a 700B LLM on 240W

·2026.05.11 07:00

A Journey Toward AI Self-Sufficiency (23 min read)

·2026.05.10 17:00

NVIDIA Unveils Star Elastic

·2026.05.10 09:00

vLLM ROCm added to Lemonade

·2026.05.09 03:00

vLLM V0 to V1: Correctness Before Correction in RL

·1·2026.05.07 06:00

Google TPU Gets 3x Faster Inference with DFlash

·2026.05.06 00:00

Analysis of LLM Inference Performance on Apple Silicon

·2026.05.05 22:00

Apple Silicon LLM Inference Performance Analysis Results

·2026.05.05 22:00

KV Cache Quantization Performance Comparison

·2026.05.02 08:00

PFlash, 10x prefill

·2026.05.01 23:00

Previous
5
6
7
8
9
Next

Previous
1
2
3
4
5
6
7
8
9
Next