←新闻详情

Philipp Schmid更新于 10月11日 13:01

Gemini 视频理解引入智能体模式,长视频 token 最多减少 88%

Gemini video understanding is now agentic. Gemini can now iteratively navigate video timelines, decide watch what, pick frame rates, or chooses whether it needs

AI 导读

Gemini 的视频理解改为智能体式处理,模型可自行浏览视频时间线、决定看哪些片段、选择帧率,并判断是否需要语音转录、音频或视觉帧来回答提示词。官方称长视频最多减少 88% 的 token 和 66% 的成本,基准准确率提升约 7%。启用方式是在 video 上设置 processing="agentic",2 分钟以内的视频仍用 static;该功能已在 Gemini API 和 Google AI Studio 上线,覆盖 Gemini 3.7 Flash、3.6 Flash 和 3.5 Flash Lite。

推荐理由

AI 评分 72

原文给出智能体式视频理解的开关参数与成本收益数字,读者可据此判断长视频处理是否值得切换。

主题

标签

正文

当前显示原文,中文全文译文尚未就绪。

Gemini video understanding is now agentic. Gemini can now iteratively navigate video timelines, decide watch what, pick frame rates, or chooses whether it needs speech transcripts, audio, or visual frames to answer your prompt.

Result: Long videos get up to 88% fewer tokens and 66% lower costs, with ~7% higher accuracy on benchmarks.

How it works: - Receives a lightweight URI reference (Files API or YouTube) and loads content via tool. - Scans speech transcripts to pinpoint relevant moments before fetching visual frames. - Navigates key timestamps and picks its own frame rate (0.1 or 10 FPS). - Pulls audio tracks directly when acoustic cues matter.

Set `processing="agentic"`on `video` to enable. Keep `static` (none) for videos under 2 minutes. Available today in the Gemini API and Google AI Studio across Gemini 3.7 Flash, 3.6 Flash, and 3.5 Flash Lite. https://t.co/2eHeIduApg

来源

Philipp Schmid