多伦多大学与Google论文:GEO评测需统一编辑规则
New University of Toronto and Google paper argues that picking an AI assistant may be the last big decision people make, since that assistant then makes the dec
多伦多大学与Google的论文提出,GEO(生成式引擎优化)基准需统一允许的网页编辑规则,否则分数无法比较。论文按改动位置、改动方式和针对的线索(如权威性)为每类GEO编辑打标签,并建议测试同时报告可见度、答案质量和规则遵循情况。该论文未做实验,证据是对11种已发表GEO方法的梳理,显示各方法覆盖的编辑类型各不相同。
正文
New University of Toronto and Google paper argues that picking an AI assistant may be the last big decision people make, since that assistant then makes the decisions that follow.
Argues that tests of how websites game AI answers need shared editing rules, or scores can't be compared.
Content owners now edit web pages so AI assistants cite or recommend them, a practice called generative engine optimization, or GEO. Current GEO benchmarks allow different edits, so a method that rewrites whole pages can look better than one that only appends a line.
They propose labeling every GEO edit by where the page changes, how it changes, and which cue it targets, such as authority. Tests would fix the allowed edits and report visibility, answer quality, and rule-following together.
The paper runs no experiments. Its evidence is a mapping of 11 published GEO methods, showing that each covers a different slice of the possible edits.
When comparing GEO methods or AI systems, check which edits each score allowed and whether answer quality was measured.