OpenRouter 推出 Visual Image Benchmarks，覆盖 39 个图像模型
Image Benchmarks: See the Capabilities of Every Model
OpenRouter 上线 Visual Image Benchmarks，用一组挑战性提示词横向对比其平台上的全部图像模型（截至 2026 年 8 月共 39 个），结果以网格展示并支持按价格和生成时间排序。提示词分为七类：不合理场景、计数、文字、空间关系、否定、编辑和一致性。同一并排对比格式也覆盖视频与语音模型，新图像模型上线后会加入网格。
正文
当前显示原文，中文全文译文尚未就绪。
Brian Thomas ·8/21/2026 · Updated 9/3/2026
Unlike choosing a text model, where we have a vast array of LLM benchmarks, picking an image model can feel arbitrary. Output samples tend to be curated eye candy and LLM-as-a-judge evals can’t yet capture the details a human would notice instantly. While arena scores help, they evaluate which outputs people prefer rather than what a model can actually do.
Today we’re launching Visual Image Benchmarks to help you quickly evaluate the capabilities of all the image models we offer (39 as of August ‘26). We’ve selected a set of challenging prompts designed to differentiate the capabilities of models, and show every result in a grid with sorting for both price and generation time.
Prompts designed to test the boundaries of image model capabilities
Each challenge is designed to differentiate the capabilities of image models. We’ve initially grouped them into seven families:
Improbable scenes. A wine glass filled level with the rim, umbrellas that are closed. Training data is full of the ordinary version of both; Counting. Three fingers, specific numbers of cards and dice; Text. One long exact string on a poster, and several languages in the same frame; Spatial relations. Occlusion and mirror reflections; Negation. A zebra with no stripes, a Times Square with no advertising; Editing. Minimal diffs, object removal, person removal, all from a reference image; Consistency. Holding a product or four reference subjects steady across a new scene
The prompts are written so you can instantly evaluate them visually. For example, can a model follow the instruction to fully fill a wine glass?
Benchmarks for video and speech models
Video and audio models are just as hard to evaluate, so the same side-by-side format now covers video and speech models too. We add new image models to the grid as they launch.
Check out our image benchmarks today! If you have any prompts that could challenge the next round of models, share it with us in #feedback on our Discord.
Generating images via the OpenRouter API and Chat
Once you’ve evaluated models via these benchmarks, try them on your own prompts through the image generation API or Chat to see how they perform on your own content.