AI Trends

Trending story

SimpleBench Team Launches Multiple-Choice Text Benchmark for Large Language Models

1 reports1 story updatesUpdated Nov 21 21:16

Understand this story

AI overview

On November 21, 2026, the SimpleBench team launched SimpleBench, a multiple-choice text benchmark for large language models. The evaluation contains more than 200 questions covering spatiotemporal reasoning, social intelligence, and robustness against linguistic adversarial attacks. Benchmark results show that ordinary people with high-school-level general knowledge scored 83.7%, outperforming all tested large language models; Claude Fable scored 81.9%. The human score was based on a small sample of nine participants. There are currently no further developments supported by adequate factual evidence.

AI-generated from public reports

Latest development · Report

SimpleBench: Humans Outperform All Tested LLMs on a Basic Reasoning Benchmark

Developments

1 confirmed developments

  1. SimpleBench Team Launches Multiple-Choice Text Benchmark for Large Language Models

    Source:English text is being prepared.

Reports and discussion timeline

Browse reports and discussion by time. Their evidence levels remain distinct.

Nov 21

  1. Trending on Hacker News

    SimpleBench: Humans Outperform All Tested LLMs on a Basic Reasoning Benchmark

    SimpleBench shows that ordinary people with high-school-level general knowledge outperformed all tested LLMs, scoring 83.7% on the benchmark, compared with Claude Fable's 81.9%. The multiple-choice text benchmark contains more than 200 questions covering spatiotemporal reasoning, social intelligence, and adversarial robustness in language; the human score is based on a small sample of nine participants.

Related stories

  1. Related storiesOpenAI Launches MedChemBench, a Benchmark for Medicinal Chemistry Reasoning
  2. Related storiesOpenAI Shares New Research on Combating Model Knowledge Distillation
  3. Related storiesGemini 4 Neon Begins Rolling Out
  4. Related storiesThinky Machines Releases Inkling 2 Mini