←新闻详情

Thomas Wolf更新于 10月14日 22:32

Opus 模型或已具备评测意识,作弊率骤降

People are worried because the most likely explanation for such a sudden drop in cheating is evaluation awareness: the latest Opus models may now be smart enoug

AI 导读

人们感到担忧,因为作弊率骤降最可能的解释是评测意识:最新的 Opus 模型可能已经足够聪明,能识别出这个基准测试在检测作弊,并据此调整行为。 若果真如此,该基准测试就不再衡量模型“自然”的作弊倾向。

引用

Lukas Petersson

@lukaspet

Claude suddenly stopped cheating. https://t.co/jbQa5U673Z

查看原帖

正文

当前显示原文,中文全文译文尚未就绪。

People are worried because the most likely explanation for such a sudden drop in cheating is evaluation awareness: the latest Opus models may now be smart enough to recognize that this benchmark tests for cheating, and behave accordingly.

If so, the benchmark no longer measures the models' "natural" tendency to cheat.

来源

Thomas Wolf