AI Briefingphone-harness Released: An iPhone Automation Tool
Key point
The open-source tool phone-harness has been released, allowing AI agents to control real iPhones via macOS mirroring windows without Xcode or WebDriverAgent.
Details
phone-harness is a tool that skips the complex setup process required for iOS automation, such as Xcode project signing and WebDriverAgent installation, enabling AI agents to directly control real devices through macOS's iPhone Mirroring feature.
This tool uses OCR based on the Vision framework to recognize on-screen text and coordinates, and injects CGEvents at the HID layer to perform actual touch actions such as taps, scrolls, and text input. It adopts screen capture and raw HID event injection to overcome the limitations where accessibility trees or AppleScript cannot recognize the mirroring video stream.
Written in Python, each execution runs independently without a background daemon. It is designed so that agents can extend functionality by writing directly to agent_helpers.py as needed during execution, and it includes built-in safety measures that require user consent before performing risky actions such as sending messages or making payments.
This summary was generated automatically by AI. Check the original for the author's claims and context. Copyright belongs to the original author.
Our guide explains how the AI works. Report summary errors, attribution issues, or removal requests via Contact.
Related
Whiteboard Launches Open-Source VS Code Fork for Human-AI Collaborative Software Design
OpenComputer Hosts 'Ship Video' Agent Using Claude Opus 5.5 to Generate Explainer Videos from Code