Databricks on AI coding cost governance: unit costs cut by up to 90%
Patrick, a product lead at Databricks, reviewed the cost overrun problem after the company fully adopted AI coding agents, saying that by migrating to cheaper models, routing, spend visibility, and cutting token overhead, unit costs in some scenarios fell by as much as 90%. He noted that hard budget caps would interrupt the best developers, so the company switched to gradual friction through warnings, approvals, and model downgrades, and productized its internal solution as Unity Gateway. The team built its own evaluation using real PRs from its own codebase, finding that GLM 5.2 matched Opus 4.8 in quality at about one-third lower cost per task, while a model that was 1.7 times cheaper per token ended up costing more per task because it consumed more tokens.
Patrick, a product lead at Databricks, reviewed the cost overrun problem after the company fully adopted AI coding agents, saying that by migrating to cheaper models, routing, spend visibility, and cutting token overhead, unit costs in some scenarios fell by as much as 90%. He noted that hard budget caps would interrupt the best developers, so the company switched to gradual friction through warnings, approvals, and model downgrades, and productized its internal solution as Unity Gateway. The te
Matched fieldsBody
