软件工厂大师课上线:从度量到 evals
final edit of our software factories masterclass with @vaibcode and @zachlloydtweets is live! We chatted about:
AI 导读
dex 宣布与 @vaibcode、@zachlloydtweets 的软件工厂大师课最终版已上线,内容涵盖软件工厂的构建模块、以度量驱动自我改进、把成功的 agent 运行转化为 evals 以测试未来模型与 harness,以及 DORA、为何按代码行数统计是糟糕指标、按 PR 数统计或许够用。
正文
final edit of our software factories masterclass with @vaibcode and @zachlloydtweets is live! We chatted about:
- software factory building blocks - a good software factory starts with measurement, then self improvement against those metrics - turning successful agent runs into evals for testing future models / harnesses / etc - DORA, why counting lines of code is bad metric, and why counting PRs might be good enough
enjoy!