TensorZero 提出把 LLM 应用看作 POMDP 而非 Agent
TensorZero 在工程博客中提出,LLM 应用应被建模为部分可观测马尔可夫决策过程(POMDP),其中智能体只对应 LLM 函数,环境包含应用中的其余代码。文章据此建议应用与 LLM 的接口应是变量之间的函数 f:X→Y 而非提示词到生成,并主张按轨迹存储观测、动作与奖励,用离线策略评估做评测。TensorZero 表示已基于这些原则构建开源生产级系统,并计划未来自动生成、评估和呈现新的函数变体。
the assumption that a function call corresponds to a single LLM call — so long as you respect the interface of f:X→Yf: \mathbb{X} \to \mathbb{Y}f:X→Y — enabling the ability to leverage complex inference-time optimizations (like the OpenAI o1 family of models). After you’ve used one or more of these techniques to generate a new policy, you’ll want to use historical data to backtest and find out if it’s good or not. These are evals, but have been studied for decades under the name offline policy e
匹配字段正文

