MIT CSAIL proposes Weight-Space Programming: GPT-6 Astra directly rewrites the weights of Qwen3.5-0.8B
Rikiya Takehi, a PhD student at MIT CSAIL, and his team propose "Weight-Space Programming," which lets GPT-6 Astra directly read and write neural network weights without training or computing gradients. In the experiment, only about 0.016% of the weights of Qwen3.5-0.8B were modified, and MATH-500 rose from 7.9 to 48.1 while GSM8K rose from 13.8 to 67.1; according to the authors, this fixes the 0.8B model's reasoning loops, improving math ability by up to 6x and instruction following by 3x.
Why read this
SelectedAI score 81
The method involves no training and no gradient computation; by changing only about 0.016% of the weights, it substantially improves the small model's math scores, illustrating the idea that frontier models can directly edit weights.
Topics
View original postWe asked GPT-6 Astra to edit Qwen3.5-0.8B weights to improve math. It directly changed only 0.016% of weights, fixing 0.8B's reasoning loops & improving math up to 6x and even instruction following 3x, without gradients or training. We call this Weight-Space Programming: frontier LLMs can now natively read/write neural network weights! 🧵 Blog: https://t.co/bOWCcFhCVq
View original
We asked GPT-6 Astra to edit Qwen3.5-0.8B weights to improve math. It directly changed only 0.016% of weights, fixing 0.8B's reasoning loops & improving math up to 6x and even instruction following 3x, without gradients or training. We call this Weight-Space Programming: frontier LLMs can now natively read/write neural network weights! 🧵 Blog: https://t.co/bOWCcFhCVq
Body · AI translation
Today's hottest AI topic on X: MIT CSAIL PhD student Rikiya Takehi and his team proposed a "weight space programming" method that requires no training and no gradient computation, letting GPT-6 Astra directly read and write the weights of a neural network. In the experiment, modifying only about 0.016% of the weights of Qwen3.5-0.8B raised MATH-500 from 7.9 to 48.1 and GSM8K from 13.8 to 67.1 ... Large models hand-crafting small models is just around the corner🤟