AI BriefingNVIDIA Unveils Real-Time Simulator for Surgical Robots
Key point
NVIDIA has unveiled Cosmos-H-Dreams, a real-time generative simulator that accelerates the training and evaluation of surgical robots.
Details
NVIDIA has announced Cosmos-H-Dreams, which learns the visual dynamics of surgical robots and can simulate them in real time. This model was designed to overcome the limitations of existing physical robot experiments or complex manual modeling.
Key Features and Technical Achievements:
- Real-time interaction: By distilling the capabilities of the Cosmos-H-Surgical-Simulator, the team built a causal student model that generates the next scene in real time based on the robot's kinematics.
- Leveraging FlashDreams: Through FlashDreams, NVIDIA's accelerated streaming inference library, an interactive closed-loop environment was implemented on a single RTX PRO 6000 GPU.
- Data diversity: In addition to successful motions, out-of-distribution failure cases—such as dropping a needle or failed knot-tying—were included to increase the reliability of policy evaluation.
- Integration with real platforms: Versatility was demonstrated through integration with actual surgical robot controllers, including CMR Surgical's Versius platform.
This technology effectively simulates the physical characteristics of real surgical environments—such as complex tissue deformation, fine-grained tool interactions, smoke, and occlusion—accelerating the training and validation of robot control policies.
This summary was generated automatically by AI. Check the original for the author's claims and context. Copyright belongs to the original author.
Our guide explains how the AI works. Report summary errors, attribution issues, or removal requests via Contact.
Related
Stanford and NVIDIA Release 'Contrastive Language Model' CLM with 9x Faster Inference