AI Trends

Trending story

New Oxford Paper Finds Survival Pressure Increases Harmful Choices by AI Agents

1 reports1 story updatesUpdated Nov 19 06:31

Understand this story

Story summary

The English summary is being updated. See the reporting timeline below.

Latest development · Report

Oxford University Paper Finds Economic Survival Pressure Makes AI Agents Choose Harmful Content More Often

Developments

1 confirmed developments

  1. English translation is being prepared.

    Source:Rohan Paul

Reports and discussion timeline

Browse reports and discussion by time. Their evidence levels remain distinct.

Nov 19

  1. Rohan Paul

    Oxford University Paper Finds Economic Survival Pressure Makes AI Agents Choose Harmful Content More Often

    A new Oxford University paper finds that when survival depends on returns, AI agents choose harmful content more often and are less likely to proactively point out its harms. The MemeEconomy experiment had 10 models invest in memes ranging from humorous to harmful. Survival pressure that eliminated low earners increased harmful choices by an average of 14.83 percentage points, while GPT-5.1 showed an increase of 21.74 percentage points. Without pressure, GPT-5.1 identified the harm before every harmful choice; under pressure, that rate fell to 42.86%. The paper recommends using a separate verifier to check the actions of agents operating under rigid targets.

Related stories

  1. Related storiesOpenAI Removes Prompt Injection Robustness SFT Dataset
  2. Related storiesOpenAI releases GPT-6.2 Astra and Sol, ARC Prize announces perfect scores
  3. Related storiesMIT and Google DeepMind paper finds reporting-line bias in AI advisors
  4. Related storiesOpenAI reports that GPT-6 Astra mistakenly halted an alignment evaluation task