←新闻详情

Artificial Analysis更新于 10月25日 21:53

Subquadratic 发布 SubQ Snap 1.1 决策模型

Subquadratic has released SubQ Snap 1.1, tying d1-ultra and Elephant 9B for first on the Artificial Analysis Decision Index v1.0, driven by a low hallucination

AI 导读

Subquadratic 发布决策模型 SubQ Snap 1.1,在 Artificial Analysis Decision Index v1.0 上得 65 分,与 d1-ultra、Elephant 9B 并列第一,领先第三名 Jev 1.14(57)8 分。其非幻觉率 86%,仅次于 Elephant 9B 的 93%,高于 d1-ultra 的 85%;准确率 20%,HLE-MultiChoice 得 18%。输入价格 $0.04/1M tokens,上下文窗口 384K,每 1M 任务成本 $30,约为同分 Elephant 9B($8.4)的 3.6 倍。

正文

Subquadratic has released SubQ Snap 1.1, tying d1-ultra and Elephant 9B for first on the Artificial Analysis Decision Index v1.0, driven by a low hallucination rate

SubQ Snap 1.1 is the new decision model from @subquadratic. It is priced at $0.04 per 1M input tokens and supports a 384K token context window, compared to 32K for d1-ultra and 16K for Elephant 9B.

Key takeaways: ➤ SubQ Snap 1.1 scores 65 on the Artificial Analysis Decision Index v1.0, tied with d1-ultra and Elephant 9B: the three models are 8 points ahead of the next model, Jev 1.14 (57).

➤ SubQ Snap 1.1's AA-Omniscience-Decision result is driven by a low hallucination rate: its non-hallucination rate of 86% is second only to Elephant 9B (93%), ahead of d1-ultra (85%). Its accuracy is 20%, compared to 32% for d1-ultra and 12% for Elephant 9B. The non-hallucination rate is the share of questions not answered correctly where the model chose "I don't know".

➤ SubQ Snap 1.1 scores 18% on HLE-MultiChoice: level with Elephant 9B (18%) and ahead of d1-ultra (15%). HLE-MultiChoice is the text-only multiple-choice subset of Humanity's Last Exam.

➤ SubQ Snap 1.1 costs $30 per 1M tasks: comparable to d1-ultra ($32), and ~3.6x the cost of Elephant 9B ($8.4), which scores the same 65.

来源

Artificial Analysis