AI Briefing
KOSign in

Microsoft Patent Describes Real-Time AI System for Altering Live Speech and Lip Movements

·2026.11.11 10:12

Key point

The system uses generative AI to replace specific words or phrases in live video while reshaping mouth movements to match the new audio.

Details

  • Microsoft has filed a patent for a system that alters speech and lip movements in real time during live broadcasts.
  • The technology analyzes voice and video to flag specific words, replacing them with generative AI while synchronizing lip movements to the new audio.
  • Potential applications include real-time translation, removing profanity or filler words, and rewriting statements using online sources.
  • The patent describes a scenario where different viewers see and hear entirely different versions of the same live event tailored to their preferences.
microsoftgenerative-aideepfakepatentreal-time-processingvideo-manipulation
Read originalShare on Threads

This summary was generated automatically by AI. Check the original for the author's claims and context. Copyright belongs to the original author.

Our guide explains how the AI works. Report summary errors, attribution issues, or removal requests via Contact.

Related

RedditMicrosoft Lazarus Research Demonstrates Backdoor in AI Agent Weights via 10 Neuron EditsMicrosoft ResearchMicrosoft Researchers Discover Lazarus: Backdoor Technique Reprogramming Dormant Neurons in AI AgentsRedditWorldFoundry: Open-Source Infrastructure for Unified World Model EvaluationHuggingFace BlogMicrosoft Releases ThinkingBox Training Stack for RL Post-Training of Agents Using Database State RewardsHacker NewsRust off Rails: An opinionated web stack for the AI era using Markdown conventions instead of codeHuggingFace BlogNVIDIA Introduces Cosmos3-H-Dreams: Real-Time Generative Surgical Simulator Trained on Clinical Cholecystectomy Data