Introducing Toast 1

Mixedbread has released Toast 1, a specialized search agent. This agent fully handles complex search loops, allowing frontier models to focus on reasoning and final answer generation.

Key Features and How It Works

• Search Loop Automation: Performs the process of decomposing initial queries into sub-queries, collecting evidence, inspecting sources, and curating relevant context.
• Maximized Efficiency: Offers up to 10x lower cost and 12x faster speed compared to existing frontier models.
• Co-design: Integrated design of embedding models, agent harnesses, and search primitives to optimize search performance.

Key Benchmark Results

• OfficeQA Pro V2: Achieved a new SOTA (State-of-the-art) in both quality and efficiency on Databricks' benchmark, recording an accuracy of 70% at a cost of approximately $1.15 per task.
• Legal Agentic Benchmark: Reduced token usage by 3.5x during legal knowledge retrieval, realizing over 60% cost savings while maintaining answer quality.