←新闻详情

谢赛宁更新于 10月14日 22:32

谢赛宁:视觉状态追踪是未来视觉的核心挑战

how does the brain build and track an internal state of the world from (possibly incomplete and noisy) visual observations?

AI 导读

大脑如何从(可能不完整且有噪声的)视觉观察中构建并追踪世界的内部状态? 我相信视觉状态追踪将成为未来几年视觉领域的重大挑战,希望这个基准能成为一个有用的起点。enjoy!

引用

Sihyun Yu

@sihyun_yu

Can MLLMs actually track what's happening in a video? Introducing VSTAT 🎯, our new benchmark for visual state tracking. The tasks are simple: count cups, read typed words, count page flips. Humans solve them easily. MLLMs don't. https://t.co/dgqhqeVuSv 🧵 [1/11]

查看原帖

正文

当前显示原文,中文全文译文尚未就绪。

how does the brain build and track an internal state of the world from (possibly incomplete and noisy) visual observations? i believe visual state tracking will be the grand challenge for vision in the coming years, and i hope this benchmark can be a useful starting line. enjoy!

来源

谢赛宁