Google Launches “Computer Control” for Gemini on macOS
Google has launched a “Computer Control” feature for Gemini on macOS that can click, type, fill out forms, and access local files and webpages across apps, independently completing multi-step tasks. The feature runs in a background window and offers live previews as well as pause and stop options. Key actions require user confirmation, and users can restrict which apps it may access. It is currently rolling out gradually to English-language users in the United States and requires Apple Silicon, macOS Sequoia 15.0 or later, and an eligible Google account and subscription.
Why read this
SelectedAI score 78
The original article also details cross-app tasks, permission confirmations, and device and subscription requirements, helping clarify the feature’s use cases and security boundaries.
Topics
Body · AI translation
Added beta-testing promotional copy Added beta-testing promotional copyend Add app-exclusive traffic redirection
IT Home, November 20 — On November 19 local time, Google announced a new “Computer Use” feature for the macOS version of the Gemini app, allowing AI to directly operate desktop applications on a Mac, access local files, browse the web, and independently complete multi-step tasks. (IT Home note: The feature is currently being rolled out gradually to English-language users in the United States.)
According to Google’s official introduction, users need only describe a task in natural language, and Gemini can switch between different applications to perform actions such as clicking, entering text, filling out forms, and navigating menus.
Examples given by Google include processing photos in batches, extracting information from local PDF files and entering it into online forms, creating presentations based on real-time data, and organizing product information and listing items for sale on secondhand marketplaces.
Gemini performs these tasks in a separate background window, without taking over the user’s current main screen or mouse pointer. The chat interface also displays a live preview of its actions, allowing users to view the AI’s progress and pause or stop the task at any time. Gemini will also ask the user for confirmation before performing critical actions.
For permission management, users can choose which applications Gemini is allowed to access instead of granting the AI control over the entire computer.
Google said the feature requires a Mac with an Apple Silicon chip running macOS Sequoia 15.0 or later. Users must also be at least 18 years old and use an eligible personal Google Account with a Google AI Plus, Pro, or Ultra subscription.
Google’s launch of the feature comes as Apple begins adjusting macOS application permission controls.
According to a developer announcement issued by Apple on November 16, macOS 27.3 Beta 2 has introduced changes to permissions for device control, data access, and Full Disk Access. The new system separates the previous device-control and data-access settings into distinct permission options, allowing users to specify which programs an application may control or which folders it may access, while also providing an option that requires user confirmation each time permission is requested.
Apple will also add transparency notifications. When an application uses the relevant permissions to control other applications, the system will display an indicator in the menu bar. Apple said that granting an application Full Disk Access may expose various types of data on a Mac to risk, so it hopes that more granular permission settings will give users a clear understanding of what an application can access and control.
According to The Verge, Apple’s changes are related to the security risks arising from the growing prevalence of AI agents. However, Apple’s permission changes predate Google’s release of Gemini’s Computer Use feature and were not a response made specifically for this application. Statement: This is an exclusive Sina.com article. Reproduction without authorization is prohibited. tech_web_article_v2015_block_bottom Non-targeted 300*250 button 17/09 wenjing begin
Non-targeted 300*250 button end
AI Trends