AINews:GPT-6.1 Sol 与 Sonnet 5.5 重塑成本性能前沿
[AINews] not much happened today - Latent.Space
OpenAI 发布 GPT-6.1 Sol,定价 $2/$10 每百万输入/输出 token,比 GPT-6 Sol 便宜 39% 且 Agent Arena 得分高 1.52 分,比 Astra 便宜 81%。Anthropic 的 Sonnet 5.5 在 Agent Arena 首秀排名第 3 并拿下 Chat 类别第 1,Anthropic 模型占据该榜前三。StepFun 的 Step 5 Preview 以 $2.54 每任务在开源权重模型中排名第 7,支持 1M token 上下文窗口。
正文
当前显示原文,中文全文译文尚未就绪。
a quiet day.
If you’re even seeing this, you should probably just go enjoy your weekend.
AI News for 10/1/2026-10/2/2026. We checked 12 subreddits, 544 Twitters and no further Discords. AINews’ website lets you search all past issues. As a reminder, AINews is now a section of Latent Space. You can opt in/out of email frequencies!
GPT-6.1 Sol and Sonnet 5.5 Reshape the Cost–Performance Frontier
GPT-6.1 Sol launch: OpenAI priced Sol at $2/$10 per million input/output tokens, compared with $10/$50 for Astra (pricing summary).Claimed results: It reportedly beats GPT-6 Sol by 6.4 points on DeepSWE v1.1 and Opus 5.5 by 2.2 points on AutomationBench (summary); Positioning: OpenAI staff describe it as “good, cheap AND fast” (@reach_vb); Codex usage: A global Codex usage reset was set for Oct 2 at 10AM PT (@reach_vb); Tool use: Sol reportedly “REALLY loves codemode,” consistent with GPT models being trained on it (@badlogicgames, codemode note); Agent Arena placements: Sol [Max] entered at #5 (+11.23%) with a $0.56 median cost per task (@arena).Sol cost comparison: That is 39% cheaper than GPT-6 Sol while scoring 1.52 points higher. It is 81% cheaper than Astra while landing within 1.04 points; Sonnet 5.5: Sonnet 5.5 [Max] debuted at #3 (+12.5%) and ranked #1 in the Chat category. It costs $2.74 per task, versus $1.58 for #2 Opus 5.5, which keeps it off the Pareto frontier (debut, frontier); Anthropic’s position: Anthropic models now hold the top three Agent Arena spots; Code and Text Arena: Sol briefly entered WebDev at #3 before Sonnet 5.5 pushed it to #4 (weekly recap).Sonnet on WebDev: Sonnet now sits 2 points behind GPT-6 Astra [Max] at 80% lower cost; Gemini 4 Argon: Argon [High] took #1 in Text Arena; Open models: MiMo-V2.6-Pro and Flash entered Agent Arena at #5 and #9 among open models; Other independent evals: WeirdML v3 finds Sol very token-efficient, close to Astra but with a lower peak. On the same benchmark, Sonnet 5.5 beats Opus 5 and Grok 4.7 beats Kimi-K3; these results are incomplete (@htihle).Reasoning style: Design Arena read 324 thinking summaries. It found that Astra hedges about 20× as often as Opus 5.5, while Opus commits early in about 4 of 5 summaries (@DesignArena); Step 5 Preview: StepFun’s model ranks #7 among open-weight models on Vals at $2.54 per task. It averages nearly two hours per task and has a 1M-token context window (Vals, details); Rumors (unconfirmed):Fable 5.5: Claude Fable 5.5 is rumored for next week and said to outperform an “Astra 6.1” that was reportedly delayed over security concerns. The poster says he cannot verify either claim (@kimmonismus, follow-up); GPT-6 Astra Lite: A “GPT-6 Astra Lite” listing has been spotted, which @scaling01 speculates is the same model as Sol (@scaling01); Decision models and open weights: llama.cpp added a /v1/systemone endpoint for local “Jev-style” decision-model inference (@ggerganov).Running locally: Models are launched with llama serve -hf ggml-org/Kev-4B-GGUF (@ClementDelangue). Jared Palmer published a post on how Kev 1.0 works (post); Ecosystem: Perplexity claims pplx-decider-v1-27b averages 85.7% across 11 benchmarks, ahead of Jev (@AravSrinivas). Clef decision models are now on Ollama (@lucataco); Skeptical view: @mervenoyann calls decision models a rebrand of zero-shot classifiers (tweet); Calibration analysis: A blog post links Jev-style calibration to value and Q-function prediction (@SOURADIPCHAKR18); webAI TwIL-LM3-Pro: This 3.66B model is post-trained from Granite 4.2. In webAI’s tests it roughly matches Qwen3-8B on formal logic. The Q4 GGUF is 2.09 GiB and the license is non-commercial (@kimmonismus); Reka RIDM: Reka released an inverse dynamics model under Apache 2.0. It is trained on games, generalizes to real video and extracts motor and camera actions (@RekaAILabs)
Multi-harness RL (Hugging Face): The same model weights score 62% in one harness and 33% in another (@huggingface).Method: A proxy speaks the OpenAI, Anthropic and Gemini API formats and records sampled token IDs and logprobs for training, with no changes to the harnesses themselves; Results: LFM2.5-2.6B improved from 42% to 54% across four harnesses and made 31% fewer tool calls. SFT on 3,189 Qwen3.8-27B rollouts plateaued at 47.5%; Release: The trainer, data and all seven trained models are open; Credit assignment and RL efficiency: ProVer has a judge locate the decisive trajectory segment, then uses rollouts on either side to set that segment’s advantage. It reports +9.91% (Qwen3.5-2B) and +7.12% (Qwen3.5-4B) relative gains over GRPO (@omarsar0).Partial rollouts: AC2 uses a learned critic to score token chunks, so training needs only partial rollouts (@wen_kaiyue); Frontier Learning: The method targets problems at the edge of capability, since problems a model always or never solves give zero GRPO gradient (@robinfaro13); Sharpening Tax: The paper quantifies the loss of pass@K scalability after post-training and proposes PTGS, a per-prompt temperature sampler (@iScienceLuvr); SFT vs RL: Another paper finds SFT generalizes worse because its data is off-policy, not because of the objective. Rewriting expert trajectories in the base model’s style closes the gap (@maximelabonne); Long-horizon control and context: Meta Superintelligence Labs reports that a dedicated controller lifts GPT-5.5 on ProgramBench from 63.7% to 71.5%, using the same workers and budget, versus 58.0% for Codex (@dair_ai).Context compression: Microsoft’s training-free FOCUS cuts peak context by up to 48% and raises task success by up to 8.9 points (@dair_ai); Long-context degradation: NVIDIA’s Long-Transduction study measures a 62.8% accuracy drop from 4K to 128K context across seven open models (@dair_ai); Multi-agent coordination: In AgentWorld, fewer than a third of multi-agent actions help complete the task, and coordination tasks reach only 12% success (@omarsar0); Apple LoopCD: The method halves recurrent loops while raising AIME 2024 pass@1 from 61.88% to 73.33% (@arankomatsuzaki); AI on open math problems: Meta released six papers on open problems produced with Muse Spark 1.1 and 1.2 through plain meta.ai chat, with no custom scaffold (@AIatMeta, list).Process: Each paper labels which passages were drafted primarily by humans or by AI, and a second group of mathematicians reviewed the work; Google Cogentic: This Gemini multi-agent system produced new results on five open theory problems (@omarsar0); Cogentic design: Each draft must pass two adversarial verifiers, and agents share a ledger of verified lemmas. Most problems took about 100 calls; the hardest took about 1,000; Image post-training: Arena combined a Bradley-Terry reward model with faithfulness, constraint and anti-reward-hacking rewards (@arena).Results: FLUX.2-dev gained 69 Elo to 1202, and Ideogram 4 gained 20 Elo to 1224
Benchmarks, Eval Integrity and Safety
Research-taste benchmarks: ScholarCatalyst asks agents to find the “catalyst papers” behind research projects. It is labeled by 184 lead authors on 207 of their own projects and is described as far from saturated (@yoonholeee).EurekaBench: This benchmark tests whether agents can discover genuinely new insights across six science domains (@JiayiiGeng); Vals Web Search Index: The index holds model and harness constant, swaps only the search tool, and scores final answers on finance and legal tasks (@ValsAI).Validation: Agents score 2.9% (legal) and 7.4% (finance) without search, versus 30–50% with it. Vals also cites a study in which a model answered 44.5% of BrowseComp without search (details); SWE bug-finding bench: In this new benchmark, agents start from an older commit and are scored against real bugs fixed in later commits.Critique: Lucas Beyer argues it mainly tests recall and that the construction is easy to train toward (@giffmana); Authors’ response: The authors say training for bug-finding is fine as long as the test set is excluded (@OfirPress); Eval integrity question: David Rein asks whether Harbor, the framework behind Terminal Bench, lets agents modify their trajectories before evaluation. He notes he may be misreading the code (@idavidrein); Offensive capability of open models: The Batch reports GLM-5.3 nearly matched Claude Mythos at exploiting vulnerabilities, 12% vs 14% (@DeepLearningAI).Disputed claim: One commentator says GLM-5.3 Flash exceeds Mythos Preview on ExploitBench (@teortaxesTex); Uncensored variant: An uncensored GLM-5.3 is circulating on Hugging Face (@kimmonismus); Safety research and safeguards: A new paper proposes using internal signals during training to improve alignment without degrading white-box monitoring (@lenalibon).NeurIPS acceptance: “Models That Know How Evaluations Are Designed Score Safer” was accepted at NeurIPS 2026 (@HaritzPuerto); False positives: Opus 5.5 frequently triggers “reasoning extraction” safeguards during spectrogram syllable labeling (@ChaseBrowe32432); Emergent world knowledge: Asking a model “land or water?” for 16,200 lat/long coordinates and plotting the answers yields a recognizable world map (@karpathy)
Inference, Hardware and Systems
Ascend 950 via DeepSeek kernels: An analysis of DeepSeek’s open-sourced DeepGEMM, FlashMLA, TileKernels and DeepEP infers the chip’s layout (@ZhihuFrontier).Estimated specs: The chip has 32 AI cores, each pairing one Cube core with two Vector cores. Estimated peaks are about 432/865/1,730 TFLOPS in BF16/FP8/FP4; Capacity: Supply may be limited, despite claims that 950s went on sale in August (@teortaxesTex); Prime Inference: Prime Intellect stores the MLA latent in NVFP4, shrinking rows from 576 to 352 bytes and fitting about 50% more cached tokens than FP8 (@PrimeIntellect).Stack: It serves GLM-5.3 on vLLM and Dynamo, and the sparse-MLA kernel is going to FlashInfer (@vllm_project); Low-precision benchmarking: Stas Bekman measured NVFP4 about 9% more efficient than MXFP4 on B200, with higher accuracy (@StasBekman).mamf-finder: The tool now benchmarks FP8, MXFP8, MXFP4 and NVFP4 (update); Memory and speed: NVHBM moves the memory controller into a custom base die, claiming up to 30% more bandwidth and 15% lower power than HBM4E (@vikramskr).Disputed economics: Micron says NVHBM will improve its margins; @vikramskr disputes this (counterpoint); Volantis: The startup is targeting up to 10K tokens/s per user on models over 10T parameters using optics (@omarsar0); Cerebras: Altman called Cerebras a close partner on speed (@sama); Capacity economics (Epoch): Epoch estimates AI infrastructure could soon support hundreds of millions to billions of agents (@EpochAIResearch).Demand gap: Just 20% utilization implies $2.6–5.3T in annual spending, against roughly $1T in lab revenue by the end of 2027 (details); Platforms: SemiAnalysis rates Google’s GPU clusters Gold tier and notes the ConnectX NCCL plugin now auto-activates (@SemiAnalysis_).Federated learning: Google Research launched TEE-backed federated learning with verifiable differential privacy (@GoogleResearch)
Industry and Policy
Anthropic and the Vatican: The NYT reports that Chris Olah raised pulling out of the Pope’s AI encyclical launch, whose text rejects machine consciousness (@ChristopherHale).Lobbying: Olah’s team reportedly lobbied the Pope’s advisers to take model consciousness seriously. He ultimately attended (@kimmonismus); Context: The article opens with Olah saying “we don’t know if A.I. models are conscious” (@buccocapital); Criticism: Aidan Gomez criticized the campaign as moral arrogance (@aidangomez). Lucas Beyer noted a transcript wording change from “create” to “train” (@giffmana); Anti-safety influence campaign: A report describes a group planning to spend at least $100M, run by a former White House deputy chief of staff, that frames AI warnings as a coordinated campaign (@NeelNanda5); New organizations: Nathan Lambert and Tom Zick launched Trillium Labs, a non-profit for open post-training recipes and infrastructure (@natolambert).Funding: Initial support comes from Halcyon Futures and Schmidt Sciences; Underdog: The private on-device AI startup announced backing from a16z, Khosla and others (@0xSigil); Governance and markets: Yoshua Bengio joined Canada’s new National Council on AI (@Yoshua_Bengio).Meta: Meta has parted ways with Virtue AI (@AndrewCurran_); Nvidia: Bloomberg reports a record high near $5.7T market value after a $150B buyback increase (@kimmonismus)
Top tweets (by engagement)
NYT report on Olah and the Pope’s encyclical — 28.7K; Karpathy’s “land or water” eval — 16.4K; Claude Code “You should know” plugin — 7.3K; Altman on dots — 6.8K; Muse Gadgets announcement — 4.9K; DeepSeek Harness desktop builds — 4.3K; Altman on the Cerebras partnership — 4.1K; Trillium Labs launch — 2.6K
/r/LocalLlama + /r/localLLM Recap
1. Qwen Local Inference: 27B Benchmarks, Fine-Tunes, and MTP
2. Local Agent Tooling: Decision Models and MCP
Pi 1.0 released - MCP support now included by default (Activity: 679): Earendil released Pi 1.0, a stable version of its minimal agent harness, with Codemode now including native MCP support by default plus non-LLM/image model support, virtual-model extensions, deferred tool loading, Anthropic cache warming, mid-conversation system messages, and TUI updates. The release also introduces experimental MIT-licensed Pi Durable for longer-running agentic applications beyond terminal/coding-agent workflows, while retaining Pi’s minimal/extensible architecture. Top comments focused on naming ambiguity—“pi” collides with many AI/dev tools—and requested clarification of what Codemode is. One commenter linked Earendil’s rationale for MCP support: “You said no MCP”.A commenter linked the maintainer’s rationale for reversing course on MCP support in Pi 1.0, pointing to the post “You said no MCP”. The thread notes that MCP is now included natively/by default, after earlier resistance from the creator based on project ethos, with users framing it as a “vital addition” for tool/server integration workflows; Clef: Open Weights decision model by Cloudflare (Activity: 619): Cloudflare announced Clef, an open-weights “decision model” intended for local/self-hosted use. A top commenter notes that Clef was post-trained from Qwen3.8-27B and that clef-flash was also released, post-trained from Qwen3.5-9B. The main substantive reaction was positive: commenters see Clef as filling a gap in the local-model ecosystem and are eager to benchmark it themselves.Commenters noted that Cloudflare Clef is post-trained from Qwen3.8-27B, with a smaller clef-flash variant post-trained from Qwen3.5-9B, framing it as a potentially important open-weights “decision model” for local inference use cases; A technical concern raised was how Clef’s quality holds up after quantization, especially below Q8, since local deployment will likely depend on lower-bit quantized variants and decision-model behavior may degrade nonlinearly under aggressive compression; The benchmark discussion focused on comparisons against models such as Laya, Kev 9B, and DiffusionGemma Jev, but one commenter criticized the eval set as too weak and argued Clef should be compared against the leading models on jevbench rather than weaker open Jev baselines; New in llama.cpp: Decision Models (Activity: 574): The post announces Decision Models support in llama.cpp: local “Jev/Jeff-like” models intended to act more like controllers/classifiers—selecting among actions, continuations, or behavioral choices—rather than purely free-form generators. No benchmark numbers or low-level implementation details were discussed in the provided comments; the main concrete use case raised was steering local roleplay models to avoid characters “going off the rails mid scene.” Commenters were skeptical about Jev as a defensible product/category, arguing the idea had “no moat” and was rapidly cloned into many Jev-like models. Others said they still do not know what these models are practically useful for, aside from possible agent/roleplay control.A commenter frames decision models as essentially a constrained classification loop: provide a JSON schema containing allowed classes plus structured/unstructured input, then have the model select exactly one category per item. The technical question is whether llama.cpp’s new support adds meaningful inference-time behavior beyond ordinary prompt-constrained JSON classification, or primarily standardizes the workflow for local models; One practical use case raised is applying decision models to local roleplay agents to reduce derailment during long scenes—i.e., using an auxiliary model or decision step to enforce state/intent constraints before generation. The thread does not report benchmarks or implementation results, but highlights a potential control-layer pattern for character consistency and scene-state management
Less Technical AI Subreddit Recap
/r/Singularity, /r/Oobabooga, /r/MachineLearning, /r/OpenAI, /r/ClaudeAI, /r/StableDiffusion, /r/ChatGPT, /r/ChatGPTCoding, /r/aivideo, /r/aivideo
1. Gemini 4 Argon Access Backlash
2. Claude Opus 5.5 Regression Reports
Opus 5.5 nerfing - how to measure, how to spot, how to sue (Activity: 2722): Poster alleges Anthropic Opus 5.5 showed a sharp post-launch regression after 5–6 days on complex C++/3D/physics/Blender MCP workloads, citing abnormal phrasing and lower code/output quality, and recommends preserving exact launch-day prompts/outputs plus latency measurements to detect potential changes such as quantization, routing, or serving optimizations under load. They frame this as a potential EU consumer-law issue under the Digital Content Directive 2019/770, specifically conformity expectations in Arts. 7–8 and modification/withdrawal notice obligations in Art. 19, arguing launch benchmarks and “most capable model” marketing may set enforceable expectations. Comments broadly agree that closed-model providers can silently degrade or reroute models and that independent auditing is needed, but no commenter provides reproducible benchmarks or direct evidence. One commenter reports similar perceived quality drops in Higgsfield outputs, describing wasted credits after initially strong generations.Commenters raised the core measurement problem with alleged closed-model degradation: because Anthropic’s hosted model weights, prompts, routing, and serving configs are opaque, users argue it is difficult to prove a regression or “nerf” without independent auditing, fixed benchmark prompts, repeated sampling, and historical baselines. One user specifically asked for an “effective test or reliable nerf tracker site,” highlighting demand for third-party longitudinal evals rather than anecdotal comparisons; Several users reported anecdotal regressions in Opus 5.5 behavior across applied workflows: one claimed it now needed help from Gemini 3.8 Flash to catch coding bugs, while another said Higgsfield design/render outputs declined after initially strong results, wasting credits. These reports are not controlled benchmarks, but they point to the kinds of tasks users want tracked: bug-finding accuracy, design/render prompt fidelity, and day-over-day output consistency; Mmmkay. I didn’t believe others at first, but something is suddenly off with Opus 5.5 (Activity: 2045): A Claude Code Enterprise PAYG user reports a sharp perceived regression in Claude Opus 5.5 Med behavior after a monthly limit reset: from architecture-first, DRY/SOLID, token-efficient implementation to verbose preambles, duplicated code, “slopcode,” and token burn resembling prior Opus 5 behavior. They claim usage jumped from roughly 70% to 90% in about an hour, versus no spend-limit increase requests during the previous week of heavy ~12h/day O5.5 use, and offer daily cost/token data for comparison. A commenter cites external sentiment tracking showing Opus 5.5 Reddit sentiment dropping from 71–73/100 on Sep 25–28 to 58 yesterday and 55 today on modelsentiment.com, while noting it measures opinion rather than backend model changes. Top comments speculate Anthropic may have reduced compute, silently changed routing, or altered token accounting after launch hype, but no direct evidence is provided. The main debate is trust/reliability: users want stable model behavior and transparent deployment/versioning rather than perceived post-release regressions.A commenter tracking Reddit sentiment reports a sharp drop for Claude Opus 5.5, with scores allegedly stable at 71–73/100 from Sep 25–28 before falling to 58 yesterday and 55 today on modelsentiment.com. They note this measures user opinion rather than model behavior, so it cannot confirm a backend change, but it may indicate a sudden perceived quality regression; Multiple users describe a suspected capability regression in Opus 5.5, especially around instruction-following and multi-part prompt adherence: one says the model now “mentions 3 things and only acknowledges 2,” and even recognizes the omission when challenged. Another user says they reverted to “xhigh effort” mode for all tasks, implying lower default reliability or reduced reasoning/compliance under normal settings; One technical hypothesis raised is that Anthropic may have temporarily allocated more compute during launch/benchmarking and later reduced inference resources or altered token accounting, leading to perceived quality degradation. This is speculative and unverified, but the complaint centers on reproducibility and reliability: users want model behavior to remain stable after release rather than changing silently under the same product name
3. AI Video Models and Motion Control
Orbiting Lora + first and last frame in MiniMax gives fantastic results (Activity: 2263): A user shared a MiniMax-H3 LoRA for generating locked-subject 360° orbit shots from first/last-frame conditioning: pablodawson/MiniMax-H3-360-Orbit-LoRA. The prompt explicitly constrains the scene to a frozen instant—no object/pose deformation, no drifting, no continued action—so that camera parallax is the only motion source, targeting cleaner pseudo-volumetric outputs suitable for downstream reconstruction workflows. A linked Reddit demo video was mentioned, but the video URL could not be inspected due to Reddit returning 403 Forbidden. Commenters framed the LoRA as especially useful for creating 3D assets: one suggested feeding the generated orbit clip into Opus to extract snapshots for 3D model generation, claiming it improves style preservation. Another commenter extrapolated that this kind of orbit-consistent video generation brings consumer volumetric/VR viewing of existing films closer.One commenter describes a workflow where an orbiting/generated 3D video snippet is fed into Opus and instructed to extract snapshots for 3D model creation. They report that this improves style capture substantially versus prompting the model without the video reference, suggesting the orbit video acts as a strong multi-view conditioning source; A technical artifact noted in the output is inconsistent motion segmentation: humans remain effectively frozen while secondary elements such as the car, hair, and background explosion continue moving. This points to MiniMax preserving the subject pose from the first/last-frame constraints while still synthesizing environmental dynamics, which can create partial-animation mismatches; Griffin, the first Human Interaction Model to pass video Turing Test it’s already #1 on NVIDIA’s benchmark for full-duplex AI video - 44% of people thought it was a real person while other systems are at ~3% (Activity: 2018): A Reddit post claims Griffin, described as a “Human Interaction Model,” is the first system to pass a video Turing Test and ranks #1 on NVIDIA’s benchmark for full-duplex AI video, with 44% of participants judging it as a real person versus roughly ~3% for other systems. The linked Reddit video could not be independently accessed due to a 403 Forbidden response, so the benchmark details, methodology, and model architecture are not verifiable from the provided source. Comments were mostly non-technical: one user joked about the human/AI reveal being reversed, while another argued the technology is unnecessary and likely to be used in predatory applications.A commenter emphasized that a 44% human-identification rate is technically significant because humans are usually highly sensitive to subtle facial, timing, and behavioral anomalies—the basis of the uncanny valley problem in CGI/animatronics. They argued this suggests Griffin is substantially beyond prior “fake human” systems, especially compared with the post’s claim that other systems score around ~3% on the same video Turing-style benchmark; One technically relevant real-world abuse case raised was AI-generated job applicants: synthetic candidates allegedly apply, conduct video interviews, get hired, and then either gain internal platform access or steal shipped work equipment. The commenter noted that large companies with weak scrutiny or limited background checks may fail to detect these AI-mediated interviews, implying full-duplex video agents could materially worsen identity-verification and hiring-security risks