Grok Imagine API

The Grok Imagine API is a unified API bundle that combines text-prompt- and image-based video generation with video editing. xAI stated that this allows users to quickly visualize ideas and even refine complex cinematic sequences.

In terms of performance, xAI emphasized improvements across quality, cost, and latency together. In the Artificial Analysis text-to-video rankings, Grok Imagine ranked #1, with Veo 3.1 Fast, Veo 3, Sora 2 Pro, and Sora 2 presented as comparison points. xAI explained that it was also designed to rank near the top on the latency and price-performance graphs.

The evaluation methodology was also disclosed in detail. For latency, the same 10 prompts were tested 10 times each for every model, measuring the P50 latency for videos at 720p resolution, 8-second length. Most measurements used fal.ai, with some direct comparisons made via Vertex API, OpenAI API, and xAI API.

The video editing features are broader.

• Add, Remove, Swap Objects: Add, remove, or swap objects
• Add Performance: Apply the user's performance onto a character
• Scene Control: Switch seasons and mood
• Object Control: Precisely edit colors and objects
• Restyle: Restructure the video's style
• Sketches to Life: Convert sketches into animation

In the editing benchmarks, based on human evaluation using IVEBench, Grok Imagine outperformed Kling o1 overall at 57% vs. 43%, and outperformed Runway Aleph overall at 64.1% vs. 35.9%. By category, Grok Imagine also showed higher rates in Instruction Following and Consistency.

xAI stated that this API is also offered through partner platforms, and can be used alongside its own API. Partners introduced so far include fal, ComfyUI, Invideo, Flora, and HeyGen, with API/SDK access, tutorials, and a hosting console provided to get started.