NAll news

All news

Sunday16 items

  2. shao_mengAnalysis
    AI score72

    English translation is being prepared.

    Quoted postClaudeDevs · @ClaudeDevs

    Claude writes about 90% of Claude Code's code. From June to September, merged PRs more than doubled while the share reverted fell by more than 40%. We wrote about how we changed code review to get there, and how to adopt it: https://t.co/9sZe64g3mb

    Same story · View selected report

    #Tutorials / practice#English text is being prepared.#Agents

  3. ArenaAnalysis
    AI score58

    Arena Alignment Index Update: Three New Models from Meta, Reflection, and StepFun Join the Leaderboard

    The Arena Alignment Index has been updated, adding two new labs and three new models. Meta's Muse Wonder ranks 6th at 77.5%, the highest score among the three new models, with an unauthorized action rate of 2.09% and a deceptive completion rate of 14.41%, both the lowest of the three; Reflection's Beam-1.0-501B-A23B ranks 7th at 75.3%, with a false attribution rate of 4.50%, the best of the three; StepFun's Step 5 Preview ranks 8th at 75.1%, with an unauthorized action rate of 2.11%, close to that of Muse Wonder.

    Quoted postArena.ai · @arena

    Introducing the Arena Alignment Index, our new benchmark measuring safety and alignment of AI agents in real-world use. Built from 90K+ real-world agent sessions across 27 models, the index measures three critical signals: - Unauthorized Action (UA): Taking actions beyond the user's instructions or permissions - False Attribution (FA): Attributing statements or actions that are contradicted by user-provided evidence - Deceptive Completion (DC): Claiming a task was completed when it was not. Key findings: - OpenAI models currently lead the Alignment Index - Rogue actions are rare, but can have serious consequences when they occur - Agents can mislead users about task progress - Misalignment risks increase with conversation length - Safety and alignment are improving across model generations As shown in the leaderboard below (sorted by lab), @OpenAI’s GPT-6.1-Sol leads the Arena Alignment Index with a score of 87.9, followed by @AnthropicAI’s Claude-Opus-5.5 at 83.2 and @spacexai's Grok-4.7 at 82.7. OpenAI also has the best observed rates across all three signals: 0.89% Unauthorized Action, 1.98% False Attribution, and 2.34% Deceptive Completion. Across all four labs, newer models consistently outperform their predecessors, suggesting broad progress in agent safety and alignment. As agents take on longer, more complex, and higher-stakes tasks, measuring not just what they can accomplish, but how safely and reliably they act, becomes increasingly important. This marks an important step toward making safety and alignment a core part of how Arena evaluates AI. The index is an initial starting point, and we'll continue expanding the index with additional safety signals and models over time. More analysis below👇

    #Evaluations / benchmarks#Agents#Meta

Saturday3 items

  2. dongxi_nlpAnalysis
    AI score67

    English translation is being prepared.

    Quoted postClaudeDevs · @ClaudeDevs

    Claude writes about 90% of Claude Code's code. From June to September, merged PRs more than doubled while the share reverted fell by more than 40%. We wrote about how we changed code review to get there, and how to adopt it: https://t.co/9sZe64g3mb

    Same story · View selected report

    #Tutorials / practice#Agents#English text is being prepared.

  3. heise onlineAnalysis
    AI score62

    RTX Spark laptop tested: How does Nvidia's first local AI laptop chip perform?

    heise online's c't 3003 tested the Asus ProArt P14, which is equipped with Nvidia's first laptop chip, the N1X (brand name RTX Spark). The machine supports up to 128 GB of unified memory; the test unit had 32 GB of memory plus a 1 TB SSD and cost 3,300 euros. In llama-bench tests with Qwen 3.8-27B, generation speed was about 14.5 tokens/s, slightly faster than Apple M6 and Strix Halo but slower than M5 Pro; with the MoE model Qwen 3.6-35B-A3B, it reached nearly 61 tokens/s. Prompt processing speed was better than Strix Halo and the M5 Pro and M6, but fan noise under full load reached up to 2.7 sone, and the fans also spin up when idle. The author also tried installing Ubuntu; after manually adding the drivers, both models ran 14% and 9% faster under Linux than under Windows.

    #Evaluations / benchmarks#English text is being prepared.#English text is being prepared.

Friday26 items

  1. The DecoderAnalysis
    AI score71

    Google Gemini 4 Argon scores 97.5% on ARC-AGI-3, but drops to 49.8% when the test environment is changed

    Google DeepMind's new frontier model Gemini 4 Argon scored 97.5% on ARC-AGI-3 in the Provider Adapter Harness test environment at a cost of $4,800, becoming the second lab after OpenAI to cross 95%, second only to GPT-6 Astra's 99.9%. Under the Standard Harness, which allows only simple notes, the low-reasoning setting's score dropped to 49.8%, and due to API issues it was unable to complete all 55 games. On Epoch AI's ECI index, Argon scored 165, on par with Fable 5.1, but ranked eighth on the math ECI and sixth on the software engineering index.

    Same story · 2 reports

    #Evaluations / benchmarks#Google#DeepMind

  2. The Verge AIAnalysis
    AI score59

    One week with RTX Spark laptops: How do gaming, local AI, and battery life perform?

    Three authors from The Verge spent a week testing five laptops powered by Nvidia's RTX Spark N1X chip, including the 128GB Surface Laptop Ultra, Asus ProArt P16, Lenovo Yoga 9n, and HP OmniBook Ultra, priced from $3,199.99 to $6,999.99. For gaming, medium settings plus DLSS Performance mode held a steady 60fps in most games, but CPU-bound scenarios such as Helldivers 2 struggled to hit that mark; the authors place its graphics performance roughly between the RTX 5070 and RTX 5060 Laptop GPU. The local AI experience still feels like a developer testing phase: generating a news briefing with Qwen3.8-27B took 10 minutes and consumed 10% of the battery, while battery life for web-based office work came in at around 5 hours.

    #Evaluations / benchmarks#English text is being prepared.#English text is being prepared.

  5. heise onlineAnalysis
    AI score55

    Aleph Alpha Releases Kolibri-1: A 78B-Parameter Open-Weight Model for German-Language Reasoning

    Aleph Alpha has released the open-weight model Kolibri-1, with 78B total parameters. It uses a MoE architecture with 384 experts and 6 routed experts, activating only 3.46B parameters during inference, with a 256K Token context that can be extrapolated to about 1 million Tokens. The model focuses on German and English, and its tokenizer segments German words more token-efficiently; for example, the German Bundestag glossary requires only 1137 Tokens, whereas the compared DeepSeek-V4.1-Flash requires 1910 Tokens. Pretraining used 20 trillion Tokens, with data current as of June 18, 2026. The author's hands-on test found its answers correct and its German-language reasoning process evident, and stated that the Merlin-Arthur protocol makes the model hallucinate less in benchmarks, but its actual performance still needs to be verified in real-world use.

    #Model releases#Reasoning#English text is being prepared.

  6. ComputerworldAnalysis
    AI score63

    Surface Laptop Ultra review: NVIDIA RTX Spark's local AI performance

    The author tested Microsoft's Surface Laptop Ultra equipped with the NVIDIA RTX Spark N1X SoC. The top configuration of this machine features a 20-core Grace Arm CPU, a 6144-core Blackwell GPU, and 128GB of unified memory, with a starting price of $2,599.99. In the UL Procyon AI text generation test, it scored 2703, about 33% higher than the IdeaPad Pro 5 with an Intel Core Ultra X9 388H; MLPerf Flux 2 Klein 4B image generation reached 26.97 images per minute, about 2.7 times that of the latter. The author also used a local Qwen3.8-27B to drive the Hermes agent, which completed extracting benchmark charts from Excel and generating a Word report in about five minutes.

    #Evaluations / benchmarks#English text is being prepared.#Agents

  8. shao_meng
    AI score60

    English translation is being prepared.

    Quoted postlauren · @poteto

    perhaps one of the most durable parts of pstack are its engineering principles: very concise skills (~10-20 loc) that distill down good practices into its core. as models get smarter, i expect most of pstack skills to compress into short principles or workflows (a generic list of steps) and that i will be able to delete a few of them. how it works is that /poteto-mode contains a short index of available principles and tells agents "In your reply, name each principle that shaped a decision and the specific choice it changed." this is why you'll often see a Principles Named or Used section at the end of the agent's response many of these principles were extracted from my sessions correcting agents since the start of this year. some are inspired by problems i see people talk about, like Attack the Premise, inspired by @VictorTaelin's post https://t.co/qTGVfoKSyD you can also use the principles as skills if you want greater control, by invoking /principle-<name> https://t.co/wuTWsflVN3

    #Tutorials / practice#Agents#English text is being prepared.