Research Medical AI System AMIE Demonstrates Real-Time Clinical Video Consultation Capabilities in Initial Study

Google Research and Google DeepMind expanded their research medical AI system AMIE to real-time clinical video consultations. By applying a multi-agent architecture based on Gemini and Project Astra, it interprets visual and auditory signals, guides virtual physical examinations, and performs real-time diagnostic reasoning.

In a randomized simulated consultation study involving patient role-players and primary care physicians, clinical evaluators positively assessed AMIE on the following core competencies:

• Thoroughness in history taking
• Diagnostic accuracy
• Appropriateness of treatment and management
• Quality of communication

Patient role-players preferred the video consultation experience over text chat. However, AMIE remains a research-stage system, and further research is needed for its responsible deployment in real-world healthcare settings.