AI News

Trending story

Amazon Bedrock open-weight models now support explicit prompt caching

1 reports1 story updatesUpdated Nov 16 23:42

Understand this story

AI overview

On November 16, 2026, AWS Machine Learning announced that Amazon Bedrock's open-weight models now support explicit prompt caching. This feature can be used together with automatic implicit caching to reuse the already-computed state of the same prompt prefix, thereby reducing input costs and response latency. In terms of billing, cache reads are billed at a price lower than standard input, while for some models cache writes are priced higher; both modes are used through the Chat Completions API, and the specific supported modes, minimum prefix length, and TTL vary by model. There are currently no further developments.

AI-generated from public reports

Latest development · Report

Enable prompt caching for open-weight models on Amazon Bedrock

Developments

1 confirmed developments

  1. Amazon Bedrock open-weight models support explicit prompt caching

    Source:AWS Machine Learning

Reports and discussion timeline

Browse reports and discussion by time. Their evidence levels remain distinct.

Nov 16

  1. AWS Machine LearningFirst-party

    Enable prompt caching for open-weight models on Amazon Bedrock

    Open-weight models on Amazon Bedrock now support explicit prompt caching, which can be used together with automatically applied implicit caching to reuse the already-computed state of the same prompt prefix, thereby reducing input costs and response latency. Cache reads are billed at a lower price than standard input, and for some models cache writes are priced higher; both modes are used through the Chat Completions API, and the specific supported modes, minimum prefix length, and TTL vary by model.

Related stories

  1. Related storiesSageMaker HyperPod Launches Data Capture Capability
  2. Related storiesNVIDIA blog showcases dual DGX Station deployment of GLM-5.3
  3. Related storiesAWS releases cross-organizational multi-agent reference architecture based on A2A
  4. Related storiesViquar Khan demonstrates building autonomous AI agents with Spring AI and Bedrock