←新闻详情

Artificial Analysis更新于 11月4日 09:25

Artificial Analysis 发布 AA-PersonalityBench…

In AA-PersonalityBench, the top open weights models on average rank lower than the top proprietary models on truthfulness, pragmatism and structure, and higher

AI 导读

Artificial Analysis 在 AA-PersonalityBench 中对比了 Intelligence Index 得分最高的 10 个开源权重模型与 10 个闭源模型,按 30 项人格特质做 1 到 100 的百分位排名。开源头部模型在 Truthful 上平均比闭源模型低 32 分,为差距最大的一项,在 Pragmatic、Evidence-Based、Structured 等特质上也排名更低,而在 Slop、Bottom-Line Summary、Scannable 上排名更高。

推荐理由

AI 评分 60

AA-PersonalityBench 用 30 项人格特质百分位对比开源与闭源头部模型,可看到两者在真实性与结构化上的系统性差异。

主题

标签

正文

In AA-PersonalityBench, the top open weights models on average rank lower than the top proprietary models on truthfulness, pragmatism and structure, and higher on slop and summarizing the bottom line

We compared the 10 open weights and 10 proprietary models measured with the highest Artificial Analysis Intelligence Index scores. Each model is percentile ranked from 1 to 100 on each of 30 personality traits. On average, the top open weights models rank 32 points lower than the top proprietary models on Truthful, the largest gap of any trait.

Average rank, top proprietary vs. top open weights:

➤ Open weights rank lower: Truthful (79 vs. 47), Pragmatic (79 vs. 49), Natural Sounding (77 vs. 52), Evidence-Based (76 vs. 47), Structured (73 vs. 45) and Literate (70 vs. 47)

➤ Open weights rank higher: Slop (30 vs. 49), Bottom-Line Summary (47 vs. 62) and Scannable (41 vs. 53)

来源

Artificial Analysis