←新闻详情

Artificial Analysis更新于 10月25日 23:39

Artificial Analysis 发布 AA-PersonalityBench 谄媚度评测

In our new benchmark AA-PersonalityBench, GPT-4o, Llama 4 Maverick, and GPT-3.5 Turbo, the three oldest models measured, rank highest on the Sycophantic persona

AI 导读

Artificial Analysis 推出 AA-PersonalityBench,评测模型谄媚(Sycophantic)人格特质,测得最老的三个模型 GPT-4o、Llama 4 Maverick 和 GPT-3.5 Turbo 排名最高,Grok 4.7、Claude Fable 5.1 与 Inkling 排名最低。Meta 五个被测模型全部在 65 分以上(Llama 4 Maverick 97、Muse Spark 1.3 87、Muse Glimmer 79、Muse Spark Open 76、Muse Wonder 65),Claude 系列全部在 55 分及以下,Grok 4.7 为全场最低。

正文

In our new benchmark AA-PersonalityBench, GPT-4o, Llama 4 Maverick, and GPT-3.5 Turbo, the three oldest models measured, rank highest on the Sycophantic personality trait. Grok 4.7, Claude Fable 5.1, and Inkling rank lowest

➤ @AIatMeta models are highly concentrated near the top: all five Meta models measured rank 65 or higher (Llama 4 Maverick 97, Muse Spark 1.3 87, Muse Glimmer 79, Muse Spark Open 76, Muse Wonder 65)

➤ @GoogleDeepMind models are spread out along the Sycophantic range: Gemini 3.1 Pro Preview ranks 89, Gemini 4 Argon 81, and Gemini 3.8 Flash 28, ranking from the top quartile to almost bottom quartile

➤ @AnthropicAI models skew on the lower end of the Sycophantic range: every Claude model measured ranks 55 or below (Claude Haiku 5.5 55, Claude Opus 5.5 46, Claude Sonnet 5.5 30 at medium effort and 25 at max, Claude Fable 5.1 4)

➤ @spacexai's Grok 4.7 model ranks the lowest of all models measured. Congratulations @elonmusk!

来源

Artificial Analysis