#nvidia-h100
The latest AI and developer news about #nvidia-h100, with the original source and a short summary.
The latest AI and developer news about #nvidia-h100, with the original source and a short summary.
PyTorch's Helion now uses compile-time heuristics to select fast kernel configurations without autotuning, achieving 1.18x speedup over Flash Linear Attention and 1.88x over torch.compile for matmuls on H100.
The new inference engine achieves 56 concurrent sessions on a single NVIDIA H100 SXM 80 GB by eliminating CPU-GPU overhead and batching continuous inference workloads.
It explains the architecture of Spain's MareNostrum V supercomputer and how it actually operates using SLURM.
Stargate is scaling into a massive AI infrastructure network, deploying over 9GW across 7 sites in the US.
One-click model deployment via FriendliAI is now available on the Hugging Face Hub.