AI Trends

Gemini’s macOS App Adds Computer-Use Capabilities

The Verge AIUpdated Nov 20 03:46

AI summary

Google has added computer-use capabilities to the Gemini macOS app, enabling it to complete multi-step tasks across local files, desktop apps, and the web. Users can choose which apps Gemini may access and monitor its actions in real time through a background window in the chat. The feature is rolling out in English to users in the United States.

Why read this

SelectedAI score 77

Gemini extends multi-step tasks to local files, desktop apps, and the web, with permission controls and real-time previews that demonstrate how computer-use agents can be put into practice.

Topics

Tags

Body

Google’s Gemini app for macOS now has computer use, meaning it can help you “get multi-step tasks done across your local files, desktop apps, and the web,” the company says . Google suggests the feature might be useful for things like speeding up workflows, filling in forms, making presentations, and listing items for sale.

Users will be able to decide which of your apps Gemini can access, and be able to follow along as Gemini works because it has its own background window that shows a live preview in your chat, Google says. The feature is rolling out now in English for users in the US.

Gemini is introducing the new feature ahead of Apple launching new restrictions for apps wanting “full disk access” on Mac due to potential risks from AI agents with computer use. A preview of the settings rolled out with this week’s macOS 27.3 beta .

Source

The Verge AI