andee: A Personal AI Agent That Lives on Your Phone and Mac Without the Cloud

Andee is a personal AI agent that resides on your smartphone and Mac, making independent judgments and taking action without user instructions. It does not require SDKs or intent exposure from specific apps. Instead of coordinate calculation, which general models are weak at, it analyzes the Accessibility Tree and screenshots to manipulate the screen using a label-based grid. It supports Android 8.1 and above and macOS 14 and above, with no need for root privileges or custom ROMs.

All memories and passwords are stored only on the device and are not transmitted to external servers. It runs the user-selected model from among OpenAI-compatible models locally, sending only the version number and phone model during update checks. It maintains consistent behavior even without external observation through a 'self-reflection' loop that re-verifies conversations after they end.

Scanning a QR code to pair two devices creates a 'friend' relationship where the smartphone and Mac delegate tasks to each other. For example, the smartphone can hand off coding tasks to the Mac, or the Mac can request a lunch order from the smartphone. Connecting to another person's device requires the owner's prior approval, and the other party cannot view the user's memories or conversation history.

It never performs final purchase confirmation steps or payment password entry, and these boundaries are enforced at the dispatcher level rather than through prompts. It supports 'long-term scenarios' such as monitoring notifications to summarize only important messages, organizing subscription services, and automatically generating meeting minutes. For apps like WeChat that protect the screen when accessibility is injected, it refuses manipulation and operates in read-only mode.