←News detail

Ma Dongxi NLPUpdated Oct 25 21:16

Dongxi NLP launches post-training series

English text is being prepared.

AI summary

Dongxi NLP has announced the launch of a post-training series. The first article points out that pretraining only teaches a model to "look at a piece of text and guess the next word," and that the training that turns a base model into a useful assistant after pretraining is collectively called post-training. The series divides post-training into three categories of techniques: instruction tuning, preference alignment, and RLVR, and will unfold over the coming weeks in the form of articles plus experimental code.

Quoted post

English text is being prepared.

@dongxi_nlp

https://t.co/z7WTfTRn20

View original

https://t.co/z7WTfTRn20

View original post

Body

预训练只教模型一件事:看到一段文字,猜下一个词。

预训练之后,为了把 base model 变成有用的助手所做的一切训练,统称 post-training(后训练)。

后训练通常分成三种技术:instruction tuning, preference alignment, 以及 RLVR。

这是后训练系列文章的第一篇,在接下来的几周,争取用深入浅出的方式,把后训练呈现出来,会配合文章和实验代码。

Source

Ma Dongxi NLP