Dongxi NLP launches post-training series
English text is being prepared.
Dongxi NLP has announced the launch of a post-training series. The first article points out that pretraining only teaches a model to "look at a piece of text and guess the next word," and that the training that turns a base model into a useful assistant after pretraining is collectively called post-training. The series divides post-training into three categories of techniques: instruction tuning, preference alignment, and RLVR, and will unfold over the coming weeks in the form of articles plus experimental code.
View original posthttps://t.co/z7WTfTRn20
View original
https://t.co/z7WTfTRn20
Body
预训练只教模型一件事:看到一段文字,猜下一个词。
预训练之后,为了把 base model 变成有用的助手所做的一切训练,统称 post-training(后训练)。
后训练通常分成三种技术:instruction tuning, preference alignment, 以及 RLVR。
这是后训练系列文章的第一篇,在接下来的几周,争取用深入浅出的方式,把后训练呈现出来,会配合文章和实验代码。