AI Briefing
KO

176B-Parameter Open Model BLOOM Released

·2022.07.12 09:00

Key point

BLOOM, the world's largest open-source multilingual language model with 176 billion parameters, has been released.

Details

BLOOM is the result of the BigScience project involving over 1,000 researchers, and is a large language model (LLM) with 176B (176 billion) parameters.

Key features are as follows:

  • Supports 46 natural languages and 13 programming languages.
  • One of the first models with over 100B parameters for many languages including Spanish, French, and Arabic.
  • Trained with full transparency, and available for anyone to download and use for research and applications under the Responsible AI License.

For research transparency, intermediate checkpoints and optimizer states from the training process were also released, and the model can be tested immediately via the Hugging Face Hub. The model was completed through a 117-day training process on France's Jean Zay supercomputer.

This summary was generated automatically by AI. Check the original for the author's claims and context. Copyright belongs to the original author.

Our guide explains how the AI works. Report summary errors, attribution issues, or removal requests via Contact.