AllFeed, trending, and board
FeedLatest news
TrendingOpen source and releases
BoardBlogs and showcases
TagsBrowse by topic

#llm-inference

The latest AI and developer news about #llm-inference, with the original source and a short summary.

AI Briefing

Privacy Policy Terms of Service Contact About Sources RSS Support us

Feed
Trending
Tags
Settings

#llm-inference - page 5 | AI Briefing

MBD-LM: Optimizing Parallel Generation for Diffusion-Based Language Models

·2026.07.04 22:00

New 'Scatter' sampler added to llama.cpp

·2026.07.04 06:00

ReFreeKV: Adaptive KV Cache Compression Technique

·2026.07.03 23:00

Program-as-Weights: A Programming Paradigm for Fuzzy Functions

·2026.07.03 21:00

Learning Unmasking Policies for Diffusion Language Models

·2026.07.02 09:00

DeepSeek Open-Sources New Framework 'DSpark' That Boosts LLM Inference Speed by Up to 85%

·2026.06.30 09:00

llama.cpp Begins Supporting DeepSeek V4

·2026.06.30 03:00

ggml CUDA Performance and Synchronization Optimization

·2026.06.27 13:00

JetSpec Boosts LLM Inference Speed by Up to 9.64x

·2026.06.26 06:00

OpenAI and Broadcom Unveil Chip Optimized for LLM Inference

·2026.06.24 15:00

Data-Driven Analysis of the Local AI Ecosystem Based on r/LocalLLaMA

·2026.06.20 17:00

Lemonade v10.8 Released: Turning Local Models into MCP Tools

·1·2026.06.18 04:00

DFlash and Spec V2 Decoding Technology

·2026.06.16 09:00

NVIDIA Blackwell Takes First Place in the First Agentic AI Infrastructure Benchmark

·1·2026.06.13 06:00

Could You Buy Your KV Cache

·1·2026.06.13 05:00

MiniMax Unveils MSA for Ultra-Long-Context Processing

·2026.06.12 23:00

EAGLE3 integration into llama.cpp completed

·2026.06.12 16:00

InfiniteKV: Open-Source KV Cache for Infinite Context

·2026.06.12 15:00

PickDiffusionGemma: 4x Faster Text Generation

·1·2026.06.11 01:00

FlashMemory DeepSeek-V4 Retriever (GitHub Repo)

·2026.06.10 09:00

OSCAR: 2-bit KV Cache Quantization Technique Released

·2026.06.10 04:00

Nvidia Proposes High-Performance CPU System for Windows PCs

·2026.06.07 09:00

Domino: 5.8x Faster Inference

·2026.06.06 21:00

llama.cpp Dynamic KV Cache Quantization Feature

·2026.06.05 03:00

Previous
3
4
5
6
7
Next

Previous
1
2
3
4
5
6
7
8
9
Next