Understand this story
Two researchers from Harvard University published a paper on October 22, 2026, titled "AI Review Comments Comprehensively Outperform High-Level Human Peer Review," comparing 134 pairs of review comments written by AI and humans. The paper claims that AI leads comprehensively across seven evaluation dimensions; three experts who formerly served as editors-in-chief of major academic journals conducted 30 blind evaluations, and in 26 of them considered the AI review comments better. The study used 124 papers and 134 paid professional review comments provided by rapidPeer, with Claude Opus 4.8 generating the review comments and GPT-5.5 serving as an unaware AI judge; among the specific claims checked, the AI factual error rate was 5.5%, versus 15.9% for humans. Subsequent reports stated that even without internet access, GPT-5.5 chose AI in all 134 comparisons. The research has currently been published as a paper, with no further progress yet.
AI-generated from public reports
Latest development · Report
Harvard study says AI review comments comprehensively outperform high-level human peer reviewDevelopments
1 confirmed developments
Reports and discussion timeline
Browse reports and discussion by time. Their evidence levels remain distinct.
Oct 26
36Kr · AI
Harvard study says AI review comments comprehensively outperform high-level human peer review
Two researchers from Harvard University published a paper on October 22, comparing 134 pairs of review comments written by AI and humans; AI led comprehensively across seven evaluation dimensions. Three experts who had served as editors-in-chief of major academic journals conducted 30 blind evaluations, and in 26 of them they considered the AI review comments better; among the specific claims checked, the AI factual error rate was 5.5%, compared with 15.9% for humans. The study used Claude Opus 4.8 to generate review comments and GPT-5.5 to serve as an unaware AI judge; even without internet access, GPT-5.5 chose AI in all 134 comparisons.
Oct 24
TMTPost · AGI
Harvard study says AI review comments comprehensively outperform high-level human peer reviewers
Two researchers from Harvard University published a paper on October 22, comparing 134 pairs of AI and human review comments; AI led comprehensively across seven evaluation dimensions. Three experts who had served as editors-in-chief of major academic journals conducted 30 blind evaluations, and in 26 of them they judged the AI review comments to be better. The study used 124 papers and 134 paid professional review comments provided by rapidPeer, with Claude Opus 4.8 generating the reviews and GPT-5.5 serving as the blind-evaluation judge. The factual error rate of AI review comments was 5.5%, compared with 15.9% for humans.
Phoenix Technology
Harvard study: AI review comments comprehensively outperform high-level human peer reviewers across seven dimensions
Two researchers from Harvard University published a paper on October 22 comparing 134 pairs of AI and human review comments, with AI leading comprehensively across seven evaluation dimensions. The study used Claude Opus 4.8 to generate review comments and GPT-5.5 as the blind-review judge; in all 134 comparisons GPT-5.5 chose the AI. In 30 blind reviews by three former academic journal editors-in-chief, 26 considered the AI better. The factual error rate of AI review comments was 5.5%, versus 15.9% for humans, and all 651 references cited by the AI with DOI or arXiv numbers actually exist.
Oct 23
Rohan Paul
Harvard study: Paper reviews written by Claude Opus 4.8 outperform human reviews on all metrics
A Harvard study used Claude Opus 4.8 to generate reviews for 1,124 papers and conducted a blind comparison against 134 expert reviews from rapidPeer. The results showed that the AI reviews outperformed the best expert reviews on all metrics tested by the authors. GPT-5.5 chose the AI review in all 132 decided pairs, and 3 former journal editors chose the AI review 87% of the time; erroneous statements about the papers accounted for 5.5% of AI reviews versus 15.9% of human reviews. Based on this, the authors suggest that teams relying on expert review can have AI complete a full first-round review, with humans making the final decision.
Heat trend for this story
- Current
- 12
- Period peak
- 13 Oct 26 12:00
- 24-hour change
- —
Move the pointer or select the chart to inspect hourly heat. Use the left and right arrow keys with a keyboard.