Amazon SageMaker AI Multi-Turn Reinforcement Learning Practical Guide: Training gpt-oss-20b with a Wordle Example
AWS has published a practical guide for multi-turn reinforcement learning (MTRL) on Amazon SageMaker AI. Using Wordle as an example, it deploys the agent and reward function to Amazon Bedrock AgentCore, and the training job updates LoRA adapters via GRPO. In the example, gpt-oss-20b at default reasoning effort improved its solve rate on held-out words from 61% to 84%, at a training token cost of about $339 and an AgentCore runtime cost of about $79. The article also details failures such as two inverted reward design errors, token invalidation under concurrency, and tool calls degrading into plain text, and recommends evaluating under the decoding settings used in final serving.

AWS has published a practical guide for multi-turn reinforcement learning (MTRL) on Amazon SageMaker AI. Using Wordle as an example, it deploys the agent and reward function to Amazon Bedrock AgentCore, and the training job updates LoRA adapters via GRPO. In the example, gpt-oss-20b at default reasoning effort improved its solve rate on held-out words from 61% to 84%, at a training token cost of about $339 and an AgentCore runtime cost of about $79. The article also details failures such as two
Matched fieldsBody




