Gemini Mac app adds computer use for controlling desktop apps and websites
Google has added computer use to the Gemini Mac app, enabling it to click, type, and complete multi-step tasks on a user's behalf in local desktop apps and on websites. Users can add @Computer use to prompts to process images in batches, fill out forms, create presentations, or prepare product listings; Desktop apps such as Blender and Autodesk Fusion have also been added to Connectors.
Why read this
SelectedAI score 85
From operating methods to specific examples, the material shows how Gemini handles multi-step tasks across desktop apps and websites, reducing manual switching and data entry.
Topics
Body
Google is upgrading the Gemini app on Mac with computer use capabilities that can work across local desktop applications and the web.
The existing Task (previously Gemini Spark) functionality in the Mac app could just access local files in conjunction with Connected Apps, like @Gmail or @Google Calendar.
Computer use lets Gemini for Mac click and type on your behalf to accomplish multi-step tasks in local desktop apps and the web, like navigating menus and filling out forms.
Many everyday tasks span desktop apps and websites that don’t connect to each other. Computer use handles the tedious steps in the background so you can save time without giving up your screen or cursor.
Example use cases include:
Speed up creative workflows: Batch color-grade photos in your favorite design software or set up complex 3D scenes.
Skip manual form entry: Extract weights, dimensions, and addresses from local PDFs to fill out multi-box shipping quotes.
Turn live data into ready-to-present decks: Pull metrics and screenshots from live dashboards across multiple regions and build a presentation in Google Slides.
Batch-list items for sale: Analyze clothing photos from a local folder, research pricing, log item details, and stage listings on resale platforms.
To use, add @Computer use to your prompt. In Customize > Connectors, you’ll see new “Desktop” apps like Blender and Autodesk Fusion join the existing Git and Obsidian integrations.
AI Trends