Gemini’s macOS App Adds Computer-Use Capabilities
Google has added computer-use capabilities to the Gemini macOS app, enabling it to complete multi-step tasks across local files, desktop apps, and the web. Users can choose which apps Gemini may access and monitor its actions in real time through a background window in the chat. The feature is rolling out in English to users in the United States.
Why read this
SelectedAI score 77
Gemini extends multi-step tasks to local files, desktop apps, and the web, with permission controls and real-time previews that demonstrate how computer-use agents can be put into practice.
Topics
Body
Google’s Gemini app for macOS now has computer use, meaning it can help you “get multi-step tasks done across your local files, desktop apps, and the web,” the company says . Google suggests the feature might be useful for things like speeding up workflows, filling in forms, making presentations, and listing items for sale.
Users will be able to decide which of your apps Gemini can access, and be able to follow along as Gemini works because it has its own background window that shows a live preview in your chat, Google says. The feature is rolling out now in English for users in the US.
Gemini is introducing the new feature ahead of Apple launching new restrictions for apps wanting “full disk access” on Mac due to potential risks from AI agents with computer use. A preview of the settings rolled out with this week’s macOS 27.3 beta .
AI Trends