AI BriefingBaseten Launches Grid, Sandboxes, and Serverless Loops
·2026.11.04 09:00
Key point
Baseten launches Grid, Sandboxes, and Loops to extend its inference platform with routing, execution, and training capabilities.
Details
- Baseten launches three product milestones: Grid (gateway, router, and guardrails), Sandboxes (stateful, VM-isolated execution), and Loops (serverless training).
- Grid acts as a single control layer for coding spend, routing tasks to the best model based on cost, quality, and KV cache hit rate.
- Loops provides serverless SFT and RL on frontier open-weight models, allowing teams to post-train and serve models directly as production endpoints while retaining weight ownership.
- Sandboxes offer stateful, pause/resumable, VM-isolated environments that scale to thousands of instances in seconds, co-located with inference for better performance.
- Grid launches as a public preview; Sandboxes move from private to public preview; Loops becomes generally available on Friday.
- The platform runs on Multi-cloud Capacity Management across dozens of clouds, delivering 99.99% uptime.
This summary was generated automatically by AI. Check the original for the author's claims and context. Copyright belongs to the original author.
Our guide explains how the AI works. Report summary errors, attribution issues, or removal requests via Contact.
Related
Qualcomm Launches Cloud AI 100 Ultra Inference Card with 128GB Memory and Up to 870 TOPS
Fireworks Unveils Ultra-fast Inference, Nexus, and Sovereign at Forge