Claude can now use your computer
TL;DR Highlight
Anthropic added direct computer control to Claude. It can now open apps, browse the web, and fill out spreadsheets — handling real desktop tasks on your behalf.
Who Should Read
Developers or professionals looking to automate repetitive computer tasks. Especially useful if you're on the Claude Pro/Max plan and working on macOS.
Core Mechanics
- It's currently in Research Preview — you can enable direct computer control in Claude Cowork and Claude Code. Since it's an early release rather than GA, it may not be perfect, and complex tasks might need a retry.
- Claude first tries to use existing app integrations like Slack and Calendar. It only asks for permission to directly control your screen when there's no connector available. In other words, it operates on a permission-based model rather than having free rein.
- You can use 'Dispatch' mode — give instructions from your phone, walk away, and your desktop handles the work. Come back and the results are ready.
- Recurring tasks like morning email scans or Friday report generation can be set up once and Claude handles them on schedule. Conversation context persists, so you don't need to re-explain every time.
- Currently available only on Pro and Max plans, macOS only. You need to update the desktop app and pair it with the mobile app.
Evidence
- Anthropic explicitly stated 'It won't always work perfectly, and complex tasks could need a second try.' They're officially acknowledging imperfections and releasing early to gather user feedback.
- The current scope covers general desktop tasks like opening apps, web browsing, and filling spreadsheets. No specific success rates or benchmark numbers have been published.
- A scenario was demonstrated where you dispatch work from mobile and find completed tasks when you return to your computer, integrated with the Claude Cowork feature.
How to Apply
- Automated recurring reports: Set up something like 'Every Friday at 5 PM, summarize this week's Slack messages into Google Sheets' and it runs automatically each week. Requires Pro/Max plan + macOS + latest desktop app.
- Delegate work while away: Dispatch from your phone's Claude app — 'Research meeting materials and draft a PPT' — and come back to find results on your desktop. (Complex tasks may need verification since it's Research Preview.)
- Automate legacy apps without connectors: Even internal tools or legacy apps without official Slack/Calendar-style integrations can be controlled via direct screen manipulation. Note that user permission is required before execution, so it's better suited for semi-automation than fully unattended scenarios.
Terminology
Related Papers
Show HN: OpenKnowledge – open source AI-first alternative to Obsidian/Notion
Git 기반 동기화와 Claude/Codex/Cursor 연동을 내장한 로컬 우선 마크다운 에디터로, AI 에이전트의 두 번째 뇌(LLM Wiki)로 활용할 수 있는 오픈소스 도구다.
The Unfireable Safety Kernel: Execution-Time AI Alignment for AI Agents and Other Escapable AI Systems
AI 에이전트가 자신의 안전장치를 우회할 수 없도록, 에이전트 프로세스 바깥에 수학적으로 증명된 강제 통제 게이트를 배치하는 아키텍처
RubyLLM: A Ruby framework for all major AI providers
OpenAI, Claude, Gemini 등 주요 AI 프로바이더를 단일 인터페이스로 통합한 Ruby 프레임워크로, Rails 통합과 에이전트 기능까지 지원해 Ruby 개발자가 AI 기능을 빠르게 붙일 수 있다.
Qwen-AgentWorld: Language World Models for General Agents
Alibaba Qwen 팀이 AI 에이전트가 행동 결과를 미리 시뮬레이션할 수 있는 'Language World Model'을 공개했다. 에이전트 훈련과 실행 경로 검증에 새로운 패러다임을 제시하는 연구다.
SHERLOC: Structured Diagnostic Localization for Code Repair Agents
버그 위치만 알려주는 게 아니라 '왜, 어떻게 고쳐야 하는지'까지 진단 리포트를 생성해서 코드 수정 에이전트의 성능을 높이는 training-free 프레임워크
Show HN: peerd – AI agent harness that runs entirely in your browser
백엔드 서버 없이 Chrome/Firefox 확장 프로그램으로만 동작하는 AI 에이전트 실행 환경으로, 브라우저 탭을 직접 조작하고 WASM Linux VM까지 구동할 수 있어 프라이버시와 보안을 동시에 챙길 수 있다.