Nathan Lambert 为 AAv5 指数与开源模型辩护
I feel a need to defend the AAv5 index and open models at the same time. Benchmarking is messier, more opinionated, and trickier than most people give credit to
AI 导读
Nathan Lambert 表示，他同时想为 AAv5 指数和开源模型辩护，并认为基准测试比多数人以为的更混乱、更主观、也更棘手。
正文
I feel a need to defend the AAv5 index and open models at the same time. Benchmarking is messier, more opinionated, and trickier than most people give credit to.