Anthropic 研究:Claude Sonnet 4.5 中的情绪概念及其功能
Anthropic 在 Claude Sonnet 4.5 中发现可泛化的情绪概念内部表征,这些表征会随语境激活并因果影响模型输出,包括偏好以及勒索、奖励作弊、谄媚等失准行为。研究把这一现象称为功能性情绪,并强调它不意味着模型拥有主观情绪体验。论文还发现情绪向量空间的主成分大致对应效价与唤醒度,且模型对当前说话者与另一方说话者维持不同的情绪表征。
age models and is thought to trace in part to the incentives of reinforcement learning from human feedback . The practical consequences of this failure mode were demonstrated when OpenAI rolled back a GPT-4o update after widespread reports of excessive flattery . Reward hacking has long been recognized as a challenge in reinforcement learning , with classic examples including RL agents finding unintended shortcuts to maximize reward. In LLMs, Von Arx et al. found that frontier models discovered
匹配字段正文




