谢赛宁:视觉状态追踪是未来视觉的核心挑战
how does the brain build and track an internal state of the world from (possibly incomplete and noisy) visual observations?
大脑如何从(可能不完整且有噪声的)视觉观察中构建并追踪世界的内部状态? 我相信视觉状态追踪将成为未来几年视觉领域的重大挑战,希望这个基准能成为一个有用的起点。enjoy!
查看原帖Can MLLMs actually track what's happening in a video? Introducing VSTAT 🎯, our new benchmark for visual state tracking. The tasks are simple: count cups, read typed words, count page flips. Humans solve them easily. MLLMs don't. https://t.co/dgqhqeVuSv 🧵 [1/11]
正文
当前显示原文,中文全文译文尚未就绪。
how does the brain build and track an internal state of the world from (possibly incomplete and noisy) visual observations? i believe visual state tracking will be the grand challenge for vision in the coming years, and i hope this benchmark can be a useful starting line. enjoy!