TensorZero Engineering Blog: List of Articles on Open-Source LLM Infrastructure
The TensorZero engineering blog has compiled multiple articles on its open-source LLM infrastructure, the latest being "Even (very) noisy LLM evaluators are useful for improving AI agents" by Alan Mishler on May 12, 2026. Previous articles covered topics such as hidden costs of LLM APIs, automated AI engineers, bandit adaptive experimentation in the LLM Gateway, OpenAI RFT evaluation, 5-30x cheaper distilled inference, and reverse engineering Cursor's LLM client.
Body
Even (very) noisy LLM evaluators are useful for improving AI agents May 12, 2026 · Alan Mishler; Stop comparing price per million tokens: the hidden LLM API costs April 16, 2026 · Gabriel Bianconi; We're building an automated AI engineer, and it works March 23, 2026 · Viraj Mehta, Gabriel Bianconi; Bandits in your LLM Gateway: Improve LLM Applications Faster with Adaptive Experimentation (A/B Testing) November 11, 2025 · Alan Mishler; Is OpenAI's Reinforcement Fine-Tuning (RFT) Worth It? September 25, 2025 · Andrew Jesson; TensorZero Raises $7.3M Seed Round to Build an Open-Source Stack for Industrial-Grade LLM Applications August 18, 2025 · Gabriel Bianconi, Viraj Mehta; Distillation with Programmatic Data Curation: Smarter LLMs, 5-30x Cheaper Inference July 29, 2025 · Andrew Jesson, Gabriel Bianconi, Aaron Hill, Viraj Mehta; Automatically Evaluating AI Coding Assistants with Each Git Commit June 26, 2025 · Viraj Mehta, Aaron Hill, Gabriel Bianconi; Reverse Engineering Cursor's LLM Client June 5, 2025 · Viraj Mehta, Aaron Hill, Gabriel Bianconi; From NER to Agents: Does Automated Prompt Engineering Scale to Complex Tasks? April 8, 2025 · Andrew Jesson, Gabriel Bianconi, Viraj Mehta; Case Study: Automating Code Changelogs at a Large Bank with LLMs April 3, 2025 · Gabriel Bianconi; Think of LLM Applications as POMDPs — Not Agents February 6, 2025 · Viraj Mehta, Gabriel Bianconi