Understand this story
On November 4, 2026, the WeChat public account "Karl's AI Watts" published a hands-on test article sharing a method for using Grok Bot together with Vercel's open-source agent-desktop to control other Agents and applications on the local machine. The article states that agent-desktop injects simulated real mouse and keyboard events via CGEvent, and can control other local Agents and CapCut to complete AI editing; compared with amontlabs' LCU solution, LCU uses the macOS accessibility API and can recognize buttons and input fields, but timeline drag areas in Electron self-drawn UIs like CapCut are almost invisible to the accessibility API, whereas agent-desktop can complete the task with an 800ms slow drag. The article also states that agent-desktop itself is only a CLI tool and does no reasoning, so when written as a script for replay it consumes zero quota; for the same editing task, the first run took 13 minutes and the second took 37 seconds, while LCU averaged 4 to 5 minutes; the drawback is that it needs to occupy a window, and pairing it with a Mac mini is recommended.
AI-generated from public reports
Latest development · Report
Using Grok Bot with Vercel's open-source agent-desktop to control local applicationsDevelopments
1 confirmed developments
Karl's AI Watts shares using Grok Bot with agent-desktop to control local Agents
Source:English text is being prepared.
Reports and discussion timeline
Browse reports and discussion by time. Their evidence levels remain distinct.
Nov 4
Karl's AI Watts
Using Grok Bot with Vercel's open-source agent-desktop to control local applications
The author tested using Grok Bot with Vercel's open-source agent-desktop, which simulates real mouse and keyboard events through CGEvent injection, and can control other local Agents and CapCut to complete AI editing. He compared it with amontlabs' LCU solution: LCU uses the macOS accessibility API and can identify buttons and input fields, but the timeline drag areas of Electron self-drawn UIs like CapCut are almost invisible to the accessibility API; agent-desktop can complete the task with an 800ms slow drag. agent-desktop itself is just a CLI tool and does no reasoning, so when written as a script for replay it consumes zero credits; for the same editing task, the first run took 13 minutes and the second took 37 seconds, while LCU averaged 4 to 5 minutes; the drawback is that it requires occupying a window, and the author recommends pairing it with a Mac mini.