Box CEO tests Gemini 4 Hydrogen: accuracy 5 percentage points higher than Gemini 3.8 Flash
Aaron Levie said Box tested Gemini 4 Hydrogen during early access using Box AI Complex Work Eval; its accuracy was 5 percentage points higher than Gemini 3.8 Flash, typical tasks took less than half the time, and it used about 12% fewer tokens. The evaluation had Box Agent use Hydrogen to handle complex enterprise document tasks in industries such as finance, consulting, and life sciences. Hydrogen will soon launch in Box AI Studio, where customers can use it to build custom agents.
Why read this
SelectedAI score 78
Box tested Gemini 4 Hydrogen on complex enterprise document tasks, providing comparison data on accuracy, latency, and token consumption.
Topics
View original postIntroducing Gemini 4 Hydrogen, an extremely capable and fast model built to bring Gemini 4 to everyone! Available to all tiers of Google AI Studio, Gemini API, Gemini for business, the Gemini app, Google Search, and paid Google AI Pro + Ultra subscribers in Google Antigravity. https://t.co/LwDPYi1UCq
View original
Introducing Gemini 4 Hydrogen, an extremely capable and fast model built to bring Gemini 4 to everyone! Available to all tiers of Google AI Studio, Gemini API, Gemini for business, the Gemini app, Google Search, and paid Google AI Pro + Ultra subscribers in Google Antigravity. https://t.co/LwDPYi1UCq
Body
Ok this is a big deal. We’ve been testing Gemini 4 Hydrogen in early access with the Box AI Complex Work Eval, and it’s a serious jump for fast models.
Hydrogen is 5 percentage points better in accuracy than Gemini 3.8 Flash. That alone would be a great boost in capability, but possibly more importantly it did the tasks in less than half the time with about 12% fewer tokens on a typical task.
For this eval, we give the Box Agent Hydrogen as a model for a series of complex tasks that represent real world work with enterprise documents across finance, consulting, life sciences, and other industries. Hydrogen will be a great model for a lot of efficient but complex tasks across these fields.
Gemini team is definitely cooking. Hydrogen will be rolling out in the Box AI Studio shortly so any customer can build a custom agent with it.