←News detail

Ma Dongxi NLPUpdated Nov 3 04:24

Dongxi NLP Questions GPT-6 Astra's Weight Editing Method: Like an LLM's He Jiankui

English text is being prepared.

AI summary

Dongxi NLP questions the Weight-Space Programming proposed by Rikiya Takehi, arguing that the method has traces of activation steering: first find the activation direction corresponding to a certain tendency of the model, such as the loop problem of being unable to stop when solving problems, and then project out the corresponding components in the 128 columns of weights that write the most into that direction. He points out that evaluations such as MMLU-Pro, GPQA, and IFEval did indeed all improve, but these benchmarks were originally all affected by loops; once the loop is fixed, scores naturally improve across the board, and the real question is the side effects. The original post claims that GPT-6 Astra only changes 0.016% of Qwen3.5-0.8B's weights, improving math by up to 6x and instruction following by 3x, with no gradients or training required.

Why read this

AI score 58

The author compares the weight editing method with activation steering, and asks whether the benchmark improvements are merely a side effect of fixing the loop.

Topics

Tags

Quoted post

Rikiya Takehi

@rikiyatakehi

We asked GPT-6 Astra to edit Qwen3.5-0.8B weights to improve math. It directly changed only 0.016% of weights, fixing 0.8B's reasoning loops & improving math up to 6x and even instruction following 3x, without gradients or training. We call this Weight-Space Programming: frontier LLMs can now natively read/write neural network weights! 🧵 Blog: https://t.co/bOWCcFhCVq

View original

We asked GPT-6 Astra to edit Qwen3.5-0.8B weights to improve math. It directly changed only 0.016% of weights, fixing 0.8B's reasoning loops & improving math up to 6x and even instruction following 3x, without gradients or training. We call this Weight-Space Programming: frontier LLMs can now natively read/write neural network weights! 🧵 Blog: https://t.co/bOWCcFhCVq

View original post

Body

非常有启发!但... 难道不像 LLM 的贺建奎么?

方法中看到了 activation steering 的影子:先找到模型某种倾向对应的激活方向,比如文中让模型算题停不下来的 loop 问题。

作者没有往模型里加一个 steering vector,而把写入这个方向最多的 128 列权重里的对应分量投影掉了。

评估使用的 MMLU-Pro、GPQA、IFEval 等确实都有提升,但这些 benchmark 原本都受 loop 影响,loop 修好了,分数当然全面提升。

问题是,副作用呢?

Source

Ma Dongxi NLP