Rohan Paul 评 RLNF：用脑信号做奖励
this is just so next level for personalized AI.
Rohan Paul 介绍 RL with Neural Feedback（RLNF）：在观看者看生成图像时直接从大脑读取唤醒信号，用简单嵌入加 k-NN 打分作为强化学习奖励。他认为这一方向很自然——人类偏好本就存在于大脑中，RLHF 把它转成点击，而 RLNF 则把脑信号直接接入奖励。
查看原帖话虽如此，我对这一新范式总体上感到兴奋。 它为我们提供了一个全新的维度来扩展 AI 模型——朝着个性化响应的方向。 而这对大规模普及的影响力，比单纯的智能更大。 如果 AI 能理解你，它就能为你创造更美好的事物。我们希望帮助为每个人打造一个更美好的世界。
查看原文
All that said, I'm generally excited about this new paradigm. It gives us a whole new axis to scale AI models - towards personalized responses. Which is more impactful to large scale adoption than just intelligence. If AI can understand you, it can make things more beautiful for you. We are hoping to help make a more beautiful world for everyone.
正文
this is just so next level for personalized AI.
arousal signals scored by a simple embedding plus k-NN reward. RL with Neural Feedback (RLNF), reads a viewer’s arousal signals directly from the brain, while they look at a generated image and uses them as the RL reward.
this direction looks so natural now. Human preference anyway lives in the brain, RLHF routed it through a click, and RLNF routes it from brain signals straight into the reward.