Introducing Computer Use for Namespace Devboxes

Give your agent a real Mac desktop. It can see the screen, click, type, and check its work in any app. Available today on macOS Devboxes.

Try it for free Read the docs

Today we're introducing Computer Use on Namespace Devboxes. Agents can now capture screenshots, click buttons, type, and navigate interfaces, extending automation beyond what an API offers.

What is Computer Use?

Coding agents have traditionally been limited to what an API exposes. If an application has no API, or its API doesn't cover a feature, the agent can't reach it. Yet many applications expose much of their functionality only through graphical user interfaces (GUIs).

Computer Use lets agents work with those interfaces directly, through screenshots and simulated mouse and keyboard input. Instead of calling an application-specific API, the agent navigates windows, clicks on screen coordinates, types text, and presses keyboard shortcuts.

It works as a loop: observe, reason, act, verify. The agent sends a screenshot of the desktop to a vision-capable model, the model picks the next action, such as a click or a keystroke, and a new screenshot shows the result.

The same loop works in a web browser or a native desktop app, with no integration to build for each one.

Devbox Controls

Give your agent the Devbox CLI and it can see and drive the desktop of a macOS Devbox. Windows support is coming soon.

For example:

Command Line

# Capture the desktop

devbox desktop screenshot my-mac-devbox --file screen.png

# Click a specific coordinate

devbox desktop click my-mac-devbox --x 1200 --y 800

# Type into the focused application

devbox desktop type my-mac-devbox --text "Hello, world!"

# Press a keyboard shortcut

devbox desktop press my-mac-devbox --key cmd+s

To watch your agent work or take over, open the same desktop in your local VNC client with Remote Desktop:

Command Line

devbox desktop connect my-mac-devbox

What's next?

With Computer Use, your agent is no longer limited to what an API exposes. Give it a macOS Devbox and it can use any app the way you do: look at the screen, click, type, and check the result.

Computer Use is available on macOS Devboxes today. Support for Windows Devboxes is coming next, so the same loop will work on Windows desktops too.

Get started with the Computer Controls documentation.