Computer Use

What it is

Computer use is AI's ability to interact with computers like a human would—seeing the screen, moving the mouse, clicking buttons, typing text. Instead of using APIs, the AI uses the visual interface. This enables interaction with any software, not just those with APIs.

Why it matters

Computer use dramatically expands what AI can automate. Any application a human can use, an agent with computer use can potentially operate. This opens up automation for legacy systems, proprietary software, and applications without programmatic interfaces.