Study shows Opus 4.8 comprehensively outperforms human experts in peer review
A study covering 124 Harvard social science papers shows that Opus 4.8 outperforms human experts on every peer review metric, with papers ranging from statistical analysis and formal models to qualitative research. Ethan Mollick cited the study and noted that academia needs to think quickly about how to adapt scientific research practice to AI.
Why read this
AI score 61
This study used 124 Harvard social science papers for a peer review comparison, providing concrete evidence that the model surpasses human experts in academic review scenarios.
Topics
Body
By every measure, Opus 4.8 beats human experts as peer reviewers in a study of 124 Harvard social science papers covering a range from statistical analyses to formal models to qualitative work.
As academics, we need to figure out how to adapt the practice of science to AI, fast. https://t.co/a9Q1pMd6E6