Artificial Analysis 音乐竞技场升级 v1.1
What's new in v1.1:
Artificial Analysis 发布 Music Arenas v1.1,引入 1000 条新提示词(每个基准 500 条),覆盖 17 种音乐流派。评分完全来自招募评审小组的盲投,公开投票不计入;新榜单基于超 37000 票盲测人类偏好,AA-Music-Vocal v1.1 超 16000 票、AA-Music-Instrumental v1.1 超 21000 票,每个上榜模型均超 2000 票。AA-Music-Vocal v1.1 不提供歌词,以衡量模型的端到端歌曲创作能力。
正文
当前显示原文,中文全文译文尚未就绪。
What's new in v1.1:
➤ We’re introducing a brand new prompt set to our Music Arenas, consisting of 1,000 prompts (500 per benchmark) curated and balanced across 17 genres, ranging from Classical and Jazz & Blues to EDM, Metal and Reggae.
➤ Each prompt tests song structure, mood, instrumentation or vocal style, with longer, more complex prompts that reflect today's prompting behavior and the emerging capabilities of frontier music models.
➤ Panel votes only: ratings come entirely from blind votes by our recruited evaluator panel. Public Arena votes do not count toward the rating.
Our updated leaderboards are launching with more than 37,000 blind human preference votes: more than 16,000 on AA-Music-Vocal v1.1 and more than 21,000 on AA-Music-Instrumental v1.1, with over 2,000 votes for every ranked model. On AA-Music-Vocal v1.1 we do not supply lyrics, so the benchmark measures each model's end-to-end songwriting.