AI News

Box CEO tests Gemini 4 Hydrogen: accuracy 5 percentage points higher than Gemini 3.8 Flash

Aaron LevieUpdated Nov 13 03:14

AI summary

Aaron Levie said Box tested Gemini 4 Hydrogen during early access using Box AI Complex Work Eval; its accuracy was 5 percentage points higher than Gemini 3.8 Flash, typical tasks took less than half the time, and it used about 12% fewer tokens. The evaluation had Box Agent use Hydrogen to handle complex enterprise document tasks in industries such as finance, consulting, and life sciences. Hydrogen will soon launch in Box AI Studio, where customers can use it to build custom agents.

Why read this

SelectedAI score 78

Box tested Gemini 4 Hydrogen on complex enterprise document tasks, providing comparison data on accuracy, latency, and token consumption.

Topics

Tags

Quoted post

Logan Kilpatrick

@OfficialLoganK

Introducing Gemini 4 Hydrogen, an extremely capable and fast model built to bring Gemini 4 to everyone! Available to all tiers of Google AI Studio, Gemini API, Gemini for business, the Gemini app, Google Search, and paid Google AI Pro + Ultra subscribers in Google Antigravity. https://t.co/LwDPYi1UCq

View original

Introducing Gemini 4 Hydrogen, an extremely capable and fast model built to bring Gemini 4 to everyone! Available to all tiers of Google AI Studio, Gemini API, Gemini for business, the Gemini app, Google Search, and paid Google AI Pro + Ultra subscribers in Google Antigravity. https://t.co/LwDPYi1UCq

View original post

Body

Ok this is a big deal. We’ve been testing Gemini 4 Hydrogen in early access with the Box AI Complex Work Eval, and it’s a serious jump for fast models.

Hydrogen is 5 percentage points better in accuracy than Gemini 3.8 Flash. That alone would be a great boost in capability, but possibly more importantly it did the tasks in less than half the time with about 12% fewer tokens on a typical task.

For this eval, we give the Box Agent Hydrogen as a model for a series of complex tasks that represent real world work with enterprise documents across finance, consulting, life sciences, and other industries. Hydrogen will be a great model for a lot of efficient but complex tasks across these fields.

Gemini team is definitely cooking. Hydrogen will be rolling out in the Box AI Studio shortly so any customer can build a custom agent with it.

Source

Aaron Levie