How Okara Runs a CMO Agent for 120,000 Companies on Vercel

Okara, an AI marketing solution, provides an AI CMO service that handles everything from marketing strategy development to execution for over 120,000 companies with a small team of 4. They process 4 billion tokens daily and operate 8 specialized sub-agents that perform SEO, social media, content creation, and more.

Previously, they had technical debt from having to individually manage SDKs from various AI model providers, but they resolved this by adopting Vercel AI Gateway. This allows new models to be reflected in the service as soon as they're released, without separate adapter development, and manages retry logic and fallback routing efficiently at the infrastructure layer.

They also used Vercel Sandbox to implement an automated loop where, when the SEO agent discovers technical issues on a website, it performs analysis in an isolated environment, fixes the code, and directly creates a Pull Request. Through this infrastructure efficiency, Okara supports large-scale clients without expanding headcount and continues sustained growth.