Vercel CEO amazed by fx v0.0.16's pace of improvement
Vercel Developers released fx v0.0.16, saying it has better prompt caching and smaller download packages and binaries: 41% fewer uncached input tokens, about 60% smaller libfx npm download size, and 2.8% smaller CLI binary. Vercel CEO Guillermo Rauch reposted it and marveled at the astonishing pace of improvement, saying it is now smaller, faster, and more token-efficient, that the team is continuously running benchmarks, and that it is required to improve its own performance on both open-source and closed-source models.
Topics
View original postfx v0.0.16 This version has better prompt caching and smaller downloads & binaries. • 41% fewer uncached input tokens • About 60% smaller libfx npm downloads • 2.8% smaller CLI binary Changelog → https://t.co/9n2qtJfh4E https://t.co/GjeEEDT8ze
View original
fx v0.0.16 This version has better prompt caching and smaller downloads & binaries. • 41% fewer uncached input tokens • About 60% smaller libfx npm downloads • 2.8% smaller CLI binary Changelog → https://t.co/9n2qtJfh4E https://t.co/GjeEEDT8ze
Body
The rate of improvement on https://t.co/3Z4NESzNKd is bewildering. It's now even smaller, faster and more token-efficient.
We're continuously benchmarking and asking it to improve its own performance across open and proprietary models.