#huggingface-optimum
The latest AI and developer news about #huggingface-optimum, with the original source and a short summary.
The latest AI and developer news about #huggingface-optimum, with the original source and a short summary.
Introduces how to efficiently deploy and run inference on the 176B-scale BLOOMZ model using 🤗 Optimum Habana on Habana Gaudi2 accelerators.
Habana Gaudi2 recorded roughly 2x faster performance than Nvidia A100 80GB in BERT training and Stable Diffusion inference, among others.