Software Factory Masterclass launched: from metrics to evals
dex announced that the final version of the Software Factory Masterclass with @vaibcode and @zachlloydtweets is now live, covering the building blocks of a software factory, metrics-driven self-improvement, turning successful agent runs into evals to test future models and harnesses, as well as DORA, why counting by lines of code is a bad metric, and why counting by number of PRs may be sufficient.
Body
final edit of our software factories masterclass with @vaibcode and @zachlloydtweets is live! We chatted about:
- software factory building blocks - a good software factory starts with measurement, then self improvement against those metrics - turning successful agent runs into evals for testing future models / harnesses / etc - DORA, why counting lines of code is bad metric, and why counting PRs might be good enough
enjoy!