←News detail

The DecoderUpdated Nov 3 21:41

Anthropic Launches Message Threads in Public Beta on the Claude Platform, Reducing First-Token Latency for Long Conversations by About 35%

AI summary

Anthropic has launched Message Threads in public beta on the Claude platform; API requests no longer resend the full conversation history, transmitting only the incremental content after the previous message. According to Anthropic's data, for requests of 500,000 to 1 million tokens, time to first token is reduced by about 35%. This feature delivers the greatest benefits to coding agents, computer-use agents, and workflows that process large numbers of documents or images; threads are stored encrypted in memory between requests and expire after five minutes of inactivity, and token usage remains unchanged because Claude still reads the full conversation history. The feature is available on the Claude platform as well as on AWS, Microsoft Foundry, and Google Cloud.

Why read this

AI score 62

The original text provides the reduction in first-token latency and the applicable scenarios, allowing readers to assess changes in invocation costs for long-conversation Agents.

Topics

Tags

Body

Anthropic released Message Threads as a public beta on its Claude platform. Until now, every API request had to resend the entire conversation history. Message Threads only transmits what's changed since the last message, cutting time to first token by about 35 percent for requests between 500,000 and one million tokens, according to Anthropic .

Coding agents, computer-use agents, and workflows processing lots of documents or images benefit the most, the company says. The thread stays encrypted in memory between requests and expires after five minutes of inactivity. Token usage doesn't change since Claude still reads the full conversation history. The feature works on the Claude platform and through AWS, Microsoft Foundry, and Google Cloud. Details are in the documentation .

Source

The Decoder