AI Trends

Trending story

Supercite Retests 210 Questions and Compares Answers from Two Days

1 reports1 story updatesUpdated Nov 18 08:00

Understand this story

Story summary

The English summary is being updated. See the reporting timeline below.

Latest development · Report

Supercite Tests 210 AI Responses on Two Consecutive Days; 84% of Brand Recommendations Change

Developments

1 confirmed developments

  1. English translation is being prepared.

    Source:English text is being prepared.

Reports and discussion timeline

Browse reports and discussion by time. Their evidence levels remain distinct.

Nov 18

  1. Trending on Hacker News

    Supercite Tests 210 AI Responses on Two Consecutive Days; 84% of Brand Recommendations Change

    Using identical settings, Supercite had ChatGPT, Gemini, Google AI Overviews, and AI Mode answer the same 210 purchasing questions on two consecutive days. Across 839 responses, the set of brands changed in 84% of cases. Brands ranked No. 1 on the first day were still mentioned the next day 90% of the time, but remained No. 1 in only 63% of cases; cited pages overlapped by just 42% between the two days. The study concludes that a single query is insufficient to represent stable AI recommendations and that continuously tracking brand mention frequency and citation sources is more appropriate.

Related stories

  1. Related storiesImperial College London Study Reveals Search-Augmented LLMs Cite Sources Without Reading Them
  2. Related storiesVals Releases Research Report: AI Models Can Be Induced to Identify Military Targets
  3. Related storiesGoogle launches Gemini 4 Hydrogen on Antigravity
  4. Related storiesAnthropic launches Claude Fable 5.2 and Claude Mythos 5.2