Aaron Levie: Agent token consumption will reach 1,000 times the current level
Box CEO Aaron Levie predicts that agents will consume 1,000 times as many tokens in the future as they do now, because they will need to run in workflows, process enterprise data, build almost all software, and secure enterprises. He believes that scaling requires simultaneously advancing the capabilities, safety, and efficiency under large workloads of both closed-source model frontiers and open-weight models, and mentioned that Suhail is building Particle for this purpose. Suhail announced the new company Particle the same day, whose particle-1 model uses about 45% fewer tokens while maintaining comparable performance.
View original post1/ Excited to announce our new company Particle This is our first step in a series of models focused on developers. With particle-1, we focused on token efficiency and managed to keep parity in performance while using ~45% fewer tokens. Live now: https://t.co/m5MvOwR9yE https://t.co/qAM7lFUPvG
View original
1/ Excited to announce our new company Particle This is our first step in a series of models focused on developers. With particle-1, we focused on token efficiency and managed to keep parity in performance while using ~45% fewer tokens. Live now: https://t.co/m5MvOwR9yE https://t.co/qAM7lFUPvG
Body
Agents are going to consume 1,000X more tokens than we consume today.
Because they’re going to be running in our workflows, processing all of our data, building out nearly all software, securing enterprises, and much more. To do this at scale we will need a variety of approaches at the frontier of AI.
This includes continuing to push the boundaries of closed models, while also increasing the capability of open weights models, making them more secure, as well as making them more efficient for large workloads.
Very exciting to see what @Suhail is building with Particle on this front.