AI BriefingAI Gateway Begins Supporting WebSocket for OpenAI Responses API
Key point
Vercel AI Gateway now supports WebSocket mode for the OpenAI Responses API, improving agent execution speed by up to 40%.
Details
Vercel's AI Gateway has begun supporting WebSocket mode for the OpenAI Responses API. This allows users to maintain a persistent connection and send only new input values and previous_response_id to continue a conversation, instead of resending the full context every time.
According to OpenAI, for Agentic workloads involving 20 or more tool calls, using WebSocket results in end-to-end execution speed improvements of up to 40%.
Key features include:
- Connection method: Opens via the
GET /v1/responsespath and accepts rawresponse.createframes through a persistent WebSocket connection. - Security and compliance: Compatible with
store=falsesettings and Zero Data Retention (ZDR). - Standard compliance: Follows OpenAI's WebSocket mode specification as-is.
This summary was generated automatically by AI. Check the original for the author's claims and context. Copyright belongs to the original author.
Our guide explains how the AI works. Report summary errors, attribution issues, or removal requests via Contact.