←新闻详情

Rohan Paul更新于 10月21日 22:46

Meta 论文:智能体记忆应对价值观类事实单独提高置信阈值

New Meta paper. Most agent memory systems use one confidence cutoff to decide which facts about a user to save, but this paper finds it works better to raise th

AI 导读

Meta 新论文发现,智能体记忆系统对用户价值观与信念类声明单独提高置信阈值,比全局统一阈值更有效。这类声明占候选记忆的 21.5%,却贡献了比其他所有类别加起来还多的无支撑声明,其被来源支持率仅 77.9%,其他事实为 96.2%。单独收紧价值观门槛后,无支撑保存事实从 6.2% 降至 4.0%,同时多保留约 13 个百分点的来源关键事实。

正文

当前显示原文,中文全文译文尚未就绪。

New Meta paper. Most agent memory systems use one confidence cutoff to decide which facts about a user to save, but this paper finds it works better to raise the cutoff only for claims about the user’s values and beliefs.

Value and belief claims made up 21.5% of candidate memories but contributed more unsupported claims than all other categories combined.

What an agent chooses not to store deserves as much design attention as how it stores and recalls memories, since bad writes become trusted facts later.

Saved claims get reused later as settled facts, yet value and belief claims were backed by the source only 77.9% of the time, versus 96.2% for other facts.

A global cutoff either lets weak value claims in or throws out good facts elsewhere.

A stricter bar on values alone cut unsupported saved facts from 6.2% to 4.0% compared with a global threshold that saved a similar share, while keeping about 13 points more of the source's key facts.

Find the fact types your extractor overreaches on and gate only those, but test on your own data, since these results come from synthetic personas.

来源

Rohan Paul