AI BriefingAI Evolving Hands-Free: NVIDIA XR AI Brings Agents to AR Glasses
Key point
NVIDIA has released the NVIDIA XR AI library for developing AI agents that perceive and act in real time on AR/XR devices.
Details
AI is expanding beyond chatbots into the physical world. NVIDIA XR AI is a developer library that helps developers connect inputs from AR glasses and XR devices with AI models, enterprise data, and accelerated computing, enabling them to build Agentic applications that perceive, reason, and act directly within workflows.
The platform offers four core capabilities:
- Real-world signal capture: Integration of video, audio, depth, pose, and sensor data
- Connection to specialized tools: Integration with NVIDIA Metropolis (visual AI), NVIDIA NeMo Retriever (enterprise knowledge retrieval), and more
- Broad model support: Support for NVIDIA Nemotron reasoning models and various foundation models
- Orchestration and runtime: Support for rapid transition from prototype to real-world production environments
Currently, Siemens is using this technology to let factory engineers check maintenance information in real time through AR glasses, while Rana is implementing a hands-free AI scientist through its LabOS system that guides experimental procedures in Stanford and Princeton university labs. This system is compatible with smart glasses from Meta, Rokid, and VITURE.
This summary was generated automatically by AI. Check the original for the author's claims and context. Copyright belongs to the original author.
Our guide explains how the AI works. Report summary errors, attribution issues, or removal requests via Contact.