Computer-Use 2.0: Agents Just Got Multi-Cursor — Francesco Bonacci, Cua
This talk introduces cua driver, an open-source tool enabling AI agents to interact with computer GUIs in the background across macOS, Windows, and Linux by leveraging accessibility APIs. It details CUABench, a robust evaluation framework with over 130 verifiable tasks designed to benchmark and ensure the trustworthiness of computer-using agents, revealing current limitations in complex tasks like circuit design. Finally, it presents cua fleet, an infrastructure solution that optimizes GPU utilization and reduces costs for RL training of these agents by dynamically managing sandbox environments.
