#parallel-decoding
The latest AI and developer news about #parallel-decoding, with the original source and a short summary.
The latest AI and developer news about #parallel-decoding, with the original source and a short summary.
NVIDIA VFlash reduces latency by up to 5.1x for robot and autonomous driving trajectory prediction.
Diffusion language models enable parallel generation but showed limitations in long contexts and batch processing.
Parallel Decoding Distillation predicts multiple denoising steps at once to improve the speed and diversity of video generation.
PaddlePaddle has released HPD-Parsing, a 1B document parsing model based on hierarchical parallel decoding, achieving the top score of 94.91% on OmniDocBench v1.6.
The paper proposes MBD-LM, a Multi-Block approach designed to improve the parallel decoding performance of Block Diffusion Language Models (BD-LMs).
NVIDIA has released a Diffusion language model family that delivers inference speeds up to 6x faster than existing AR models.