Anthropic Raises Series B Funding to Develop Safe and Reliable AI

Anthropic has raised $580 million in Series B funding. The funds will be used to build large-scale experimental infrastructure to explore and improve the safety of computationally intensive AI models.

Since its founding in 2021, Anthropic has continued research into steerability, robustness, and interpretability of systems. Key research achievements include:

• Developing techniques to mathematically reverse-engineer the behavior of small language models
• Understanding the pattern-matching behavior principles of LLMs
• Techniques to make models more 'helpful and harmless,' and research into RLHF-based reinforcement learning

The core of this research is developing the technical elements needed to build large-scale models with built-in safety measures while minimizing post-training interventions. In parallel, Anthropic will also develop tools to verify that these safety measures actually work, and build teams and partnerships to explore the policy and social impact of AI.

CEO Dario Amodei stated that this investment will allow the company to explore the predictable scaling properties of machine learning systems, while closely investigating unpredictable capabilities and safety issues that may emerge at large scale.