←Search results

By relevance · Total 116 results Clear search

Wednesday

Wednesday

  1. Ma Dongxi NLP

    Reinforcement Learning Terminology for LLM Readers: How a Single Score Is Distributed to Each Token

    The article uses DeepSeek-R1-Zero's pass@1 on AIME 2024 rising from 15.6% to 71.0% as an example to show that a rule-based judge gives only a single score for the entire response, whereas training needs to adjust the probability of each token. The author uses the sampling example "Is OpenAI open?" to explain in turn policy, state, action, reward, return, value, Q, advantage, baseline, TD error, GAE, clipping, and KL, and points out that PPO uses a critic to learn V, while GRPO uses the average score within a group to replace V.

    The article uses DeepSeek-R1-Zero's pass@1 on AIME 2024 rising from 15.6% to 71.0% as an example to show that a rule-based judge gives only a single score for the entire response, whereas training needs to adjust the probability of each token. The author uses the sampling example "Is OpenAI open?" to explain in turn policy, state, action, reward, return, value, Q, advantage, baseline, TD error, GAE, clipping, and KL, and points out that PPO uses a critic to learn V, while GRPO uses the average s

    Matched fieldsSummary、Body

  2. Testing Catalog

    Artificial Analysis Intelligence Index v5 is live, Claude…

    Artificial Analysis Intelligence Index v5 is live, featuring 2 new benchmarks and 3 upgrades, of which 60% are based on private test sets or held-out answers. Claude Opus 5.5 (max) leads with 58 points, followed closely by GPT-6 Astra (max) at 57 points and GPT-6.1 Sol (max) at 55 points, with Gemini 4 Argon (high) further back at 50 points. The gap between open-weight models and the leader has widened from 3 points to 12 points; among released weights, DeepSeek V4.1 Flash 1017 (max) and GLM-5.3 (max) lead with 32 points.

    gence Index v5 is live, featuring 2 new benchmarks and 3 upgrades, of which 60% are based on private test sets or held-out answers. Claude Opus 5.5 (max) leads with 58 points, followed closely by GPT-6 Astra (max) at 57 points and GPT-6.1 Sol (max) at 55 points, with Gemini 4 Argon (high) further back at 50 points. The gap between open-weight models and the leader has widened from 3 points to 12 points; among released weights, DeepSeek V4.1 Flash 1017 (max) and GLM-5.3 (max) lead with 32 points.

    Matched fieldsSummary

  3. Shao Meng

    Blake Anderson open-sources ai-app-playbook, using a Coding Agent to build consumer-grade apps on a fixed stack…

    Blake Anderson has open-sourced "ai-app-playbook," an operating playbook for coding agents to execute, covering product selection, building, launch, and first-month profitability. It has two layers: a human-facing playbook/00–13 chapters and an Agent-facing AGENTS.md (Phase 0–14, with each step marked [AGENT] or [HUMAN]); before starting, one must pass the Gate A scoring. The tech stack is fixed on Cloudflare Workers, D1, Better Auth, OpenRouter routing to DeepSeek, Superwall plus Stripe, etc., and explicitly lists a long set of non-choices such as Vercel, Supabase, and Next.js.

    gents to execute, covering product selection, building, launch, and first-month profitability. It has two layers: a human-facing playbook/00–13 chapters and an Agent-facing AGENTS.md (Phase 0–14, with each step marked [AGENT] or [HUMAN]); before starting, one must pass the Gate A scoring. The tech stack is fixed on Cloudflare Workers, D1, Better Auth, OpenRouter routing to DeepSeek, Superwall plus Stripe, etc., and explicitly lists a long set of non-choices such as Vercel, Supabase, and Next.js.

    Matched fieldsSummary、Body

Tuesday

  1. Artificial Analysis full article

    Artificial Analysis releases Intelligence Index v5, with 60% of evaluations switched to private datasets

    Artificial Analysis releases Intelligence Index v5, adding two new benchmarks, FrontierCode 2.0 and Terminal-Bench-Science, upgrading HLE-Diamond, AA-Omniscience v1.1, and CritPt v2, with 60% of evaluations based on private test sets or held-out answers. Claude Opus 5.5 (max) ranks first with 58 points, followed closely by GPT-6 Astra (max) at 57 points and GPT-6.1 Sol (max) at 55 points, with Gemini 4 Argon (high) at 50 points. The gap between open-weight models and the leaders has widened from 3 points to 12 points; the released-weight DeepSeek V4.1 Flash 1017 (max) and GLM-5.3 (max) both score 32 points. The per-task cost of leading models differs by more than 13 times: GPT-6.1 Terra (max) is $0.96, while Claude Fable 5.1 (max) is $13.04. A Progress Index v1 was also released, placing models released since November 2022 on the same capability scale for comparison.

    6.1 Sol (max) at 55 points, with Gemini 4 Argon (high) at 50 points. The gap between open-weight models and the leaders has widened from 3 points to 12 points; the released-weight DeepSeek V4.1 Flash 1017 (max) and GLM-5.3 (max) both score 32 points. The per-task cost of leading models differs by more than 13 times: GPT-6.1 Terra (max) is $0.96, while Claude Fable 5.1 (max) is $13.04. A Progress Index v1 was also released, placing models released since November 2022 on the same capability scale

    Matched fieldsSummary、Body

Saturday

  1. ArenaSelected

    Kimi K3.1 Pro (Max) ranks 11th on Agent Arena, up 6 percentage points from Kimi K3

    Kimi K3.1 Pro (Max) ranks 11th in Arena's Agent Arena, achieving a +7.6% net improvement based on 4K+ real agent sessions, up 6 percentage points from Kimi K3 (Max)'s 25th place. Its median cost per task is $1.03, 13% lower than the previous version, ranking 8th, 9th, and 10th in the Work, Code, and Chat categories respectively. Arena stated that the model's open weights will be released soon, at which point it will become the top-ranked open-source model in Agent Arena, surpassing DeepSeek-v4.1-Flash.

    .1 Pro (Max) ranks 11th in Arena's Agent Arena, achieving a +7.6% net improvement based on 4K+ real agent sessions, up 6 percentage points from Kimi K3 (Max)'s 25th place. Its median cost per task is $1.03, 13% lower than the previous version, ranking 8th, 9th, and 10th in the Work, Code, and Chat categories respectively. Arena stated that the model's open weights will be released soon, at which point it will become the top-ranked open-source model in Agent Arena, surpassing DeepSeek-v4.1-Flash.

    Matched fieldsSummary、Body

  2. Ahead of AI

    Sebastian Raschka releases an 11-hour video course on building a reasoning model from scratch

    Sebastian Raschka has released 8 programming videos on building a reasoning model from scratch, totaling 11 hours, using Python and PyTorch to implement evaluation, inference-time scaling, reinforcement learning, and distillation starting from a pretrained Qwen3 0.6B model. The course first builds a math answer verifier and evaluates on MATH-500, then implements temperature sampling, top-p filtering, and self-consistency, followed by RLVR training with a simplified version of GRPO, and finally distills a small model using answers generated by DeepSeek R1. The content accompanies his book "Build a Reasoning Model (From Scratch)"; the early text generation and evaluation examples can run on a CPU, while later training experiments are recommended to use a GPU.

    model. The course first builds a math answer verifier and evaluates on MATH-500, then implements temperature sampling, top-p filtering, and self-consistency, followed by RLVR training with a simplified version of GRPO, and finally distills a small model using answers generated by DeepSeek R1. The content accompanies his book "Build a Reasoning Model (From Scratch)"; the early text generation and evaluation examples can run on a CPU, while later training experiments are recommended to use a GPU.

    Matched fieldsSummary、Body

  3. Testing Catalog

    Kimi K3.1 Pro rises to 8th on WebDev Arena; Kimi returns to 4th in the lab rankings

    Kimi K3.1 Pro rises to 8th on Code Arena: WebDev with a score of 1692, tying Claude Opus-5 (Max) at 70% lower cost; compared with Kimi K3 (Max)'s 17th place and 1655 points, it improves 9 places and 37 points. Kimi thus returns to the top 4 in the Code Arena: WebDev lab rankings. The model is priced at $2/$10 per million input/output tokens, with a median cost per task of $1.23, 29% lower than Kimi K3; the official announcement says open weights will be released soon, at which point it will become the top-ranked open-source model on the leaderboard, surpassing DeepSeek-v4.1-Flash.

    s-5 (Max) at 70% lower cost; compared with Kimi K3 (Max)'s 17th place and 1655 points, it improves 9 places and 37 points. Kimi thus returns to the top 4 in the Code Arena: WebDev lab rankings. The model is priced at $2/$10 per million input/output tokens, with a median cost per task of $1.23, 29% lower than Kimi K3; the official announcement says open weights will be released soon, at which point it will become the top-ranked open-source model on the leaderboard, surpassing DeepSeek-v4.1-Flash.

    Matched fieldsSummary

  4. Artificial AnalysisSelected

    Kimi K3.1 Pro scores 64% on the Artificial Analysis Cybersecurity Index, ranking first among openly available models

    Kimi K3.1 Pro scores 64% on the Artificial Analysis Cyber Index, 7 points higher than the previous leader among openly available models, DeepSeek V4.1 Flash 1017 (57%), and 5 points lower than GPT-6 Sol (Daybreak Blue, max, 69%), which is available only through the OpenAI trusted access program. The index consists of three benchmarks: CWE-Bench-AA, DeepsecBench-AA, and CyberGym-E2E-AA. K3.1 Pro achieves 95% on CyberGym-E2E-AA, higher than GPT-6 Sol (Daybreak Blue)'s 93%. Its per-task cost is $2.81, higher than GPT-6 Sol (Daybreak Blue, max)'s $1.77 and DeepSeek V4.1 Flash 1017's $0.42, because although its per-token price is 33% lower than Kimi K3's, its input token usage is about 2 times as much.

    Kimi K3.1 Pro scores 64% on the Artificial Analysis Cyber Index, 7 points higher than the previous leader among openly available models, DeepSeek V4.1 Flash 1017 (57%), and 5 points lower than GPT-6 Sol (Daybreak Blue, max, 69%), which is available only through the OpenAI trusted access program. The index consists of three benchmarks: CWE-Bench-AA, DeepsecBench-AA, and CyberGym-E2E-AA. K3.1 Pro achieves 95% on CyberGym-E2E-AA, higher than GPT-6 Sol (Daybreak Blue)'s 93%. Its per-task cost is $2.

    Matched fieldsSummary、Body

Monday

  1. Artificial AnalysisSelected

    MiniMax-M3.1-Flash scores 42 on the Artificial Analysis Intelligence Index

    MiniMax-M3.1-Flash scores 42 on the Artificial Analysis Intelligence Index, 13 points higher than MiniMax-M3, at less than half the latter's per-task cost. It scores 48% on Humanity's Last Exam and 22% on CritPt, both higher than GLM-5.3-Flash and Gemini 3.8 Flash, and slightly lower than DeepSeek V4.1 Flash 1017. The model has a 1M-token context window, supports text and image input, is priced at $0.15/$0.60 per 1M input/output tokens, and its weights are currently closed-source; MiniMax announced that it will open the weights on October 23.

    nalysis Intelligence Index, 13 points higher than MiniMax-M3, at less than half the latter's per-task cost. It scores 48% on Humanity's Last Exam and 22% on CritPt, both higher than GLM-5.3-Flash and Gemini 3.8 Flash, and slightly lower than DeepSeek V4.1 Flash 1017. The model has a 1M-token context window, supports text and image input, is priced at $0.15/$0.60 per 1M input/output tokens, and its weights are currently closed-source; MiniMax announced that it will open the weights on October 23.

    Matched fieldsSummary、Body

  2. Artificial Analysis full articleSelected

    Artificial Analysis launches HealthBench and HealthBench…

    Artificial Analysis has launched leaderboards for OpenAI's two health dialogue benchmarks, HealthBench and HealthBench Professional; the former contains 5,000 conversations with general users and health workers, while the latter consists of 525 conversations all aimed at clinicians. On HealthBench Professional, GPT-6 Astra (max) ranks first with a length-adjusted score of 66.0%, GPT-6.1 Sol (max) is at 65.1%, and Claude Sonnet 5.5 (max with fallback) is at 63.0%. On HealthBench, Claude Sonnet 5.5 (max with fallback) leads at 62.1%, while DeepSeek V4.1 Flash (max) is at 60.9%; Claude Opus 5.5 and Claude Fable 5.1 average about 5,900 characters per answer and lose more than 11 points after length adjustment.

    le the latter consists of 525 conversations all aimed at clinicians. On HealthBench Professional, GPT-6 Astra (max) ranks first with a length-adjusted score of 66.0%, GPT-6.1 Sol (max) is at 65.1%, and Claude Sonnet 5.5 (max with fallback) is at 63.0%. On HealthBench, Claude Sonnet 5.5 (max with fallback) leads at 62.1%, while DeepSeek V4.1 Flash (max) is at 60.9%; Claude Opus 5.5 and Claude Fable 5.1 average about 5,900 characters per answer and lose more than 11 points after length adjustment.

    Matched fieldsSummary、Body

Tuesday

Saturday

Friday

  1. heise online

    Aleph Alpha Releases Kolibri-1: A 78B-Parameter Open-Weight Model for German-Language Reasoning

    Aleph Alpha has released the open-weight model Kolibri-1, with 78B total parameters. It uses a MoE architecture with 384 experts and 6 routed experts, activating only 3.46B parameters during inference, with a 256K Token context that can be extrapolated to about 1 million Tokens. The model focuses on German and English, and its tokenizer segments German words more token-efficiently; for example, the German Bundestag glossary requires only 1137 Tokens, whereas the compared DeepSeek-V4.1-Flash requires 1910 Tokens. Pretraining used 20 trillion Tokens, with data current as of June 18, 2026. The author's hands-on test found its answers correct and its German-language reasoning process evident, and stated that the Merlin-Arthur protocol makes the model hallucinate less in benchmarks, but its actual performance still needs to be verified in real-world use.

    s on German and English, and its tokenizer segments German words more token-efficiently; for example, the German Bundestag glossary requires only 1137 Tokens, whereas the compared DeepSeek-V4.1-Flash requires 1910 Tokens. Pretraining used 20 trillion Tokens, with data current as of June 18, 2026. The author's hands-on test found its answers correct and its German-language reasoning process evident, and stated that the Merlin-Arthur protocol makes the model hallucinate less in benchmarks, but its

    Matched fieldsSummary、Body

Tuesday

Thursday

Tuesday

Friday

Saturday