AI Trends

Google Gemini Adds Mac App Control

MacRumors Apple IntelligenceUpdated Nov 20 04:40

AI summary

Google is expanding Gemini for Mac, enabling it to use apps, files, and websites in the background to complete multi-step tasks without disrupting the user's foreground work. It can handle repetitive operations such as clicking, typing, navigating menus, and filling out forms, while providing a live preview in an isolated window within the Gemini chat interface. Users can specify which apps it is allowed to use, and Gemini will request approval before performing critical actions.

Why read this

SelectedAI score 82

The material also explains background multi-step operations, isolated windows, and approval mechanisms for critical actions, helping clarify the capabilities and permission boundaries of desktop agents.

Topics

Tags

Body

Google today expanded Gemini's capabilities, allowing it to take full advantage of your Mac. Gemini for Mac can use apps, files, and websites to complete multi-step tasks in the background while you work in the foreground.

According to Google, Gemini can do repetitive work, handling clicking, typing, menus, and forms. It works in an isolated window with a live preview in the Gemini chat interface so you can keep an eye on what it's doing.

You can choose the apps that Gemini can use, and it will ask for approval before taking "key actions."

Google suggests Gemini's new feature is useful for batch editing photos, preparing listings for resale platforms, and turning metrics and screenshots into a presentation.

The new option for Gemini to take control of a Mac is available before macOS 27.3 launches, so the timing is convenient. With the update, Apple will warn users about the dangers of giving apps unrestricted access to their data, making it clearer exactly what AI agents will be able to see and do.

Apple will let users limit access to specific apps and folders and configure apps to get permission each time access is requested. There's also a transparency indicator that makes it clear when an app is controlling another app.

Users who install apps asking for Mac permissions now won't have to re-grant those permissions after macOS 27.3 is released, nor will users see the new explanation screens Apple is putting in place.

Source

MacRumors Apple Intelligence