Huang Renxun says doubling model speed can double AI lab revenue
Huang Renxun stated that, under the premise that demand exceeds capacity, doubling model speed (for example, through software or kernel optimization) can double AI lab revenue. Inference revenue equals the number of tokens served multiplied by the price per token; faster kernels can increase tokens per second under the same GPUs, power, and data center conditions. If all additional tokens can be sold at the current price, a 2x speedup can double revenue with zero additional capital expenditure.
Why read this
AI score 52
Huang Renxun breaks inference revenue down into token count multiplied by unit price, explaining how kernel optimization directly amplifies revenue when demand exceeds capacity.
Topics
Body
Jensen Huang says doubling model speed (e.g. with software or kernel optimization) doubles an AI lab’s revenue, which holds only while demand outruns capacity.
Inference revenue is tokens served multiplied by the price of each token.
Faster kernels raise tokens per second on the same GPUs, the same power, and the same building.
If every extra token finds a buyer at today’s price, a 2x speedup does double revenue with zero new capex. https://t.co/uBi358ndjP