←News detail

Nathan LambertUpdated Oct 25 19:50

Nathan Lambert comments on the reverse analysis of Tinker StableReinforce

AI summary

Martin Marek posted that Tinker's new StableReinforce objective is Reinforce plus Score Centering, and shared his own reverse-engineering process. Nathan Lambert reposted and commented that this is a good post, and that some RL details used by closed labs are slowly leaking out.

Quoted post

Martin Marek

@mrtnm

Tinker's new StableReinforce objective is Reinforce + Score Centering. Here's how I reverse-engineered it 🧵

View original

Tinker's new StableReinforce objective is Reinforce + Score Centering. Here's how I reverse-engineered it 🧵

View original post

Body

Nice thread, some RL details used by closed labs slowly leaking out.

Source

Nathan Lambert