360 billion tokens, 3 million customers, 6 engineers

Durable is an AI business builder that helps entrepreneurs launch a business in minutes and optimize SEO, content, operations, and more through AI agents. It currently processes about 1.1 billion tokens per day (360 billion per year) while running millions of individual businesses.

As a small team, Durable chose an integrated platform over self-hosting to reduce the burden of infrastructure management. In particular, it had to solve the following problems that arise in a multi-tenant environment:

• Cost and complexity of managing custom domains and SSL
• Maintaining multi-region clusters
• Security and bot protection (protecting other customers from DDoS attacks)
• Observability and cost attribution

As AI agents became a core feature, Durable faced three technical challenges distinct from those of a typical web platform:

• Model orchestration: the ability to quickly swap models and providers for reliability and cost
• Tenant isolation: strict guardrails to prevent one business's context from leaking into another's
• Per-customer AI economics: precise cost tracking for usage-based or outcome-based billing

To focus on creating value through agents instead of building infrastructure, Durable consolidated its platform into a single system optimized for multi-tenant AI workloads.