#variance-reduction

The latest AI and developer news about #variance-reduction, with the original source and a short summary.

Deriving Policy Gradients for LLMs: From REINFORCE to GRPO and Handling Inference Mismatch

This article derives policy gradient methods for LLMs, explaining how REINFORCE evolves into GRPO through baseline variance reduction and addressing the gradient bias caused by inference engine mismatches.

·2026.09.27 16:00

ReSWD: Steady Like ReSTIR - Variance Reduction by Combining Reservoir Sampling and Sliced Wasserstein Distance

By combining Reservoir Sampling with SWD, it reduces high-variance estimation and unstable gradients.

·2025.10.03 02:00