Computer Use
Computer Use is the bridge between answer engine and action engine. When a customer's Claude can browse, click, and fill forms on your site, you've crossed from "being mentioned" to "being used". That's a different AEO conversation.
Strong signal and real results. Worth committing a pilot to.
Agent protocol·Multimodal
What It Is
Computer Use is Anthropic's capability that lets Claude control a computer by looking at a screen, moving a cursor, clicking, and typing. The feature graduated from preview to general availability in March 2026 across Claude Opus 4.7, Opus 4.6, Opus 4.5, and Sonnet 4.6. Claude prioritises existing connectors (Slack, Google Calendar, etc.) where they exist, steps up to browser control when no connector is available, and only takes direct desktop control when both options don't apply. The zoom feature lets Claude view a specific screen region at full resolution by passing coordinates.
Why It Matters
Computer Use changes the AEO question. Citation puts your business in an answer. MCP exposes specific tools to AI assistants. Computer Use lets Claude actually use your website the way a customer does, including pages and flows that have no API. For AEO buyers, that means accessibility, form labelling, navigation clarity, and the absence of CAPTCHAs and other anti-bot measures all become AEO signals, not just usability concerns. Whether Claude (or another agent using similar capability) can complete a booking, get a quote, or sign up depends on whether your interface is navigable for an agent reading the screen.
Safety and trust matter here. Anthropic includes prompt-injection scanning to protect against malicious websites or applications hijacking Claude's actions. User confirmation is required before actions, and users can interrupt at any time. For businesses, that means agent-driven flows aren't fully autonomous; the customer is still in the loop. AEO planning should assume the agent and the customer cooperate on the action, not that the agent acts alone.
Key Developments
- March 2026: Computer Use generally available across Opus 4.7, 4.6, 4.5, and Sonnet 4.6. Zoom feature added. Claude for Chrome browser extension launched.
- 2025: Computer Use API matured through research preview. Connectors-first action model adopted to reduce direct browser control.
- Oct 2024: Computer Use introduced with Claude 3.5 Sonnet.
What to Watch
Watch which sites and flows agents can complete vs which they fail. Failures are AEO problems even though they look like UX problems. Track competitor agent-action capabilities. OpenAI Operator and Google's agent-action work are direct competitors that will reshape the space. Watch how Computer Use integrates with MCP, A2A, and OAGP. As structured agent protocols mature, Computer Use becomes the fallback for the long tail of sites that haven't published structured interfaces.
Strengths
- Works on any site: No structured API or schema required. The fallback for the long tail of sites without agent protocols.
- Connector-first prioritisation: Claude prefers structured connectors when available, which keeps action efficient where it can be.
- Generally available across Claude tiers: Out of preview, in production for Pro and Max users.
- Prompt-injection scanning + user confirmation: Safety controls reduce the "AI takes destructive action" risk that worried early adopters.
Considerations
- Slower than structured protocols: Browsing and clicking is meaningfully slower than calling a typed tool.
- Brittle on bad UI: Claude can fail on confusing layouts, hidden elements, or aggressive anti-bot defences. Your AEO becomes your accessibility.
- User-in-the-loop friction: Confirmation steps reduce autonomy, which limits use cases that need full hands-off completion.
- Anthropic-only: Computer Use is a Claude capability. Cross-engine ubiquity is not yet here, though competitors are catching up.
Articles
Computer Use· ACP — Agent Communication Protocol· A2A Protocol· Model Context Protocol· Agent discovery manifests· OAGP — Open Agent Gateway Protocol