ElevenLabs Introduces Interaction Engine, Memory, and Partner Program at NYC Summit

• ElevenLabs announced the Interaction Engine, a system that manages conversation rhythm and selects the appropriate LLM for each step to optimize cost and performance.
• New ElevenAgents features include Memory, which retains customer context across interactions, and Routines, an automation layer for multi-step tasks before, during, and after conversations.
• The company launched the ElevenLabs Partner Program and Marketplace, expanding its network to over 550 partners in 44 countries and introducing an alliance with McKinsey.
• ElevenLabs is expanding its partnership with NVIDIA, making Nemotron 3.5 Super VL available in ElevenAgents and adding 15 MW of Vera Rubin compute capacity.

Model and Deployment Updates

• Scribe v3 Medical, a domain-specific Speech to Text model, accurately transcribes complex medical terms like cycloserine and cyclosporine.
• Businesses will soon be able to fine-tune open-source language models and ElevenLabs voice models using their own deployment data.
• ElevenAI, a new app for enterprise teams, provides meeting notes and dictation powered by Scribe v3, with free early access opening today.

Enterprise Ecosystem

• The ElevenLabs Marketplace offers curated industry-specific AI applications for healthcare, finance, insurance, education, and retail.
• Partners handle integrations into existing tech stacks or work with ElevenLabs Forward Deployed Engineers on complex deployments.