Nathan Lambert Defends the AAv5 Index and Open Source Models
AI summary
Nathan Lambert said he wants to defend both the AAv5 index and open source models, and believes that benchmarking is messier, more subjective, and trickier than most people think.
Body
I feel a need to defend the AAv5 index and open models at the same time. Benchmarking is messier, more opinionated, and trickier than most people give credit to.