Perplexity Releases JOLT Post-Training Method
AI summary
Perplexity unveils new research JOLT: a post-training method that lets the same model act as both teacher and student, with the teacher trained to give feedback usable by the student. On MATH, it reaches accuracy comparable to GRPO with 6.5x fewer training tokens.
Body
New research: We developed JOLT, a post-training method where one model acts as both teacher and student, with the teacher trained to give feedback the student can use.
On MATH, it matched GRPO's accuracy with 6.5x fewer training tokens.