AI BriefingVercel AI Gateway Adds Timeout Configuration for Faster Automatic Failover
Key point
Vercel AI Gateway now supports per-inference timeout configuration, enabling faster automatic failover.
Details
Vercel AI Gateway now supports per-inference timeout configuration. This allows requests that aren't responding to be cut off faster than the provider's default settings, automatically failing over to the next available provider.
Currently, this feature is available in beta only for BYOK (Bring Your Own Key) credentials, with system provider timeout support coming soon. Note that some providers don't support stream cancellation, so you may still be billed for timed-out requests.
Users can specify timeouts in milliseconds via the providerTimeouts setting within providerOptions.gateway. When combined with the order option, this allows fine-grained control over provider execution order and failover speed.
This summary was generated automatically by AI. Check the original for the author's claims and context. Copyright belongs to the original author.
Our guide explains how the AI works. Report summary errors, attribution issues, or removal requests via Contact.