←Story detail

Trending story

SemiAnalysis says Anthropic is running an A/B gray test on Claude subscription quotas

2 reports1 discussions3 story updatesUpdated Oct 23 20:04

Understand this story

AI overview

SemiAnalysis posted on X on October 23, 2026, confirming that Anthropic is quietly running an A/B gray test on Claude subscription quotas in the background. It used two identical $200 Max 20x accounts to run Opus 5.5 Agent workloads and found that one account's 5-hour window quota was 2.076 billion tokens, 19% higher than the other account's 1.74 billion tokens, but the weekly total quota dropped from 6.579 billion tokens to 5.266 billion tokens, a 20% shrinkage. Claude Code technical staff member Lydia Hallie said the quotas were not adjusted and advised users to run the feedback command to submit their IDs for investigation; core developer Boris Cherny said the team is urgently investigating.

AI-generated from public reports

Latest development · Report

SemiAnalysis's hands-on testing claims Anthropic is running an A/B gray test on Claude subscription quotas

Developments

1 confirmed developments

  1. SemiAnalysis says Anthropic is running an A/B gray test on Claude subscription quotas

    Source:36Kr · AI

Reports and discussion timeline

Browse reports and discussion by time. Their evidence levels remain distinct.

Oct 23

  1. 36Kr · AI

    SemiAnalysis's hands-on testing claims Anthropic is running an A/B gray test on Claude subscription quotas

    SemiAnalysis ran an Opus 5.5 agent workload on two identical $200 Max 20x accounts and found that one account's 5-hour window quota was 2.076 billion tokens, 19% higher than the other account's 1.74 billion tokens, but the weekly total quota fell from 6.579 billion tokens to 5.266 billion tokens, a 20% shrinkage. Claude Code technical staff member Lydia Hallie said the quotas were not adjusted and suggested users run the feedback command to submit their ID for investigation; core developer Boris Cherny said the team is urgently investigating. The article also mentions that OpenAI previously halved the quota of its $200 Pro plan and introduced a $500 tier, as well as DeepSeek's open-source inference framework DeepInfer and its deployment practice of 155 trillion tokens per day of throughput on a single cluster.

  2. Phoenix Technology

    SemiAnalysis testing found that Claude subscription quotas were lowered by a backend A/B test

    SemiAnalysis ran an Opus 5.5 agent workload on two identical $200 Max 20x accounts and found that the gray-test account's total weekly quota dropped from 6.579 billion tokens to 5.266 billion tokens, a shrinkage of about 20%, while the 5-hour window quota rose from 1.74 billion tokens to 2.076 billion tokens. Claude Code technical staff member Lydia Hallie responded that quotas had not been adjusted, and core developer Boris Cherny said the team is investigating. The article also mentioned that OpenAI previously halved the quota of its $200 Pro plan and introduced a new $500 tier, as well as the engineering practice of DeepSeek's open-source inference framework DeepInfer, with a single cluster's daily throughput of 155 trillion tokens.

  3. Phoenix TechnologyRelated discussion

    Phoenix Technology joined this discussion

    This post contributes to heat; it is not a formal report or confirmed fact.

Heat trend for this story

Current
6
Period peak
18 Oct 23 21:00
24-hour change
—

Move the pointer or select the chart to inspect hourly heat. Use the left and right arrow keys with a keyboard.

Related stories

  1. Related storiesDeepSeek open-sources inference framework DeepInfer
  2. Related storiesMiniMax releases the M3.1 Flash model
  3. Related storiesAnthropic pitches investors and discloses revenue growth ahead of listing
  4. Related storiesReport: DeepSeek raises about 100 billion yuan in new funding round