AI BriefingTencent Releases UI-Mate-27B
Key point
Tencent has released UI-Mate-27B, an open-source GUI agent that performs desktop tasks using natural language instructions and demo-based learning.
Details
Tencent has released an open-weight GUI agent called UI-Mate-27B. Based on Qwen3.6-27B, this model observes live screenshots and generates structured keyboard and mouse actions to perform long-horizon tasks in native desktop environments.
Key features include:
- General Computer Use: Executes tasks based on natural language instructions and screenshots.
- Demo-Guided Computer Use: Adaptively applies workflows extracted from successful demos to new tasks, performing real-time replanning rather than following fixed scripts.
- Technical Specifications: Distributed under the Apache-2.0 license, offering pyautogui-compatible structured actions and an OpenAI-compatible serving interface.
- Performance: Demonstrated strong general computer use performance and single-demo procedural learning capabilities on Ubuntu and Windows benchmarks.
The model was trained through Supervised Fine-Tuning (SFT) followed by Online Reinforcement Learning (Online RL) in executable GUI environments.
This summary was generated automatically by AI. Check the original for the author's claims and context. Copyright belongs to the original author.
Our guide explains how the AI works. Report summary errors, attribution issues, or removal requests via Contact.
Related
Jevper Released: A Jev Classification Wrapper for OpenAI-Compatible Models with Automatic Logprobs Detection
Rootless Linux Sandbox 'Drop' Released for Isolating AI Agents and Third-Party Programs