Meta's new paper proposes RSD: agents can learn from unlabeled historical trajectories
Meta's new paper proposes the RSD method, which lets AI agents review each step after knowing the task outcome and learn from historical attempts that no one labeled as right or wrong. On ScienceWorld, Qwen3-14B's success rate rose from 12.9% to 20.6%; on ALFWorld, Qwen3-8B reached 76.6%, surpassing all tested methods, including those that received rewards or standard answers. The authors recommend keeping agents' unlabeled run records (including failures) and regenerating the review notes each round, because when notes were frozen at round 3 the ALFWorld success rate stayed at 59.7%, while updating notes each round gave 67.9%.
Why read this
AI score 55
Meta's RSD method lets agents learn from unlabeled complete trajectories, and the success rate numbers on ScienceWorld and ALFWorld give comparable results.
Topics
Body
New Meta paper finds that AI agents can learn from their own past attempts at tasks, even ones nobody marked right or wrong, by looking back at each step once they know how it ended.
Most agent runs come with no correct answer and no reward, which standard training relies on. RSD has the same model reread each finished run, knowing how it ended and what worked on similar tasks. It scores every action, and the agent learns from those scores.
On ScienceWorld, Qwen3-14B's success rate rose from 12.9% to 20.6%. On ALFWorld, Qwen3-8B hit 76.6%, beating every other method tested, even ones given rewards or ground truth.
Keep your agent's unlabeled runs, failures included, and train it on a hindsight review of them. Rebuild the review each round, since frozen notes left ALFWorld success at 59.7% by round 3, versus 67.9% with fresh ones.