AI 热点

Gemini Mac 应用新增 computer use,可操控桌面应用与网页

9to5Google更新于 11月20日 03:39

Gemini app for Mac adds computer use to control desktop apps

AI 导读

Google 为 Gemini Mac 应用新增 computer use,使其能代用户在本地桌面应用和网页中点击、输入并完成多步骤任务。用户可在提示词中加入 @Computer use,批量处理图片、填写表单、制作演示文稿或准备商品上架;Connectors 中还新增 Blender 和 Autodesk Fusion 等 Desktop 应用。

推荐理由

精选AI 评分 85

从操作方式到具体案例,材料展示了 Gemini 如何跨桌面应用与网页处理多步骤任务,减少手工切换与录入。

主题

标签

正文

Google is upgrading the Gemini app on Mac with computer use capabilities that can work across local desktop applications and the web.

The existing Task (previously Gemini Spark) functionality in the Mac app could just access local files in conjunction with Connected Apps, like @Gmail or @Google Calendar.

Computer use lets Gemini for Mac click and type on your behalf to accomplish multi-step tasks in local desktop apps and the web, like navigating menus and filling out forms.

Many everyday tasks span desktop apps and websites that don’t connect to each other. Computer use handles the tedious steps in the background so you can save time without giving up your screen or cursor.

Example use cases include:

Speed up creative workflows: Batch color-grade photos in your favorite design software or set up complex 3D scenes.

Skip manual form entry: Extract weights, dimensions, and addresses from local PDFs to fill out multi-box shipping quotes.

Turn live data into ready-to-present decks: Pull metrics and screenshots from live dashboards across multiple regions and build a presentation in Google Slides.

Batch-list items for sale: Analyze clothing photos from a local folder, research pricing, log item details, and stage listings on resale platforms.

To use, add @Computer use to your prompt. In Customize > Connectors, you’ll see new “Desktop” apps like Blender and Autodesk Fusion join the existing Git and Obsidian integrations.

来源

9to5Google