antirez:AI 网络安全不是工作量证明
AI cybersecurity is not proof of work
antirez 认为 AI 网络安全不能类比工作量证明:算力更多的一方不会必然获胜,因为代码状态与模型采样路径会饱和,瓶颈是模型智能水平而非采样次数 M。他以 OpenBSD SACK 漏洞为例,指出弱模型跑再多 token 也无法真正理解该漏洞,只会靠模式匹配产生幻觉;模型越强反而越少误报。因此未来网络安全比拼的是更好的模型以及更快获取这些模型的能力。
正文
当前显示原文,中文全文译文尚未就绪。
The proof of work is the wrong analogy: finding hash collisions, while exponentially harder with N, is guaranteed to find, with enough work, some S so that H(S) satisfies N, so an asymmetry of resources used will see the side with more "work ability" eventually winning.
But bugs are different:
1. Different LLMs executions take different branches, but eventually the possible branches based on the code possible states are saturated.
2. If we imagine sampling the model for a bug in a given code M times, with M large, eventually the cap becomes not "M" (because of saturated state of the code AND the LLM sampler meaningful paths), but "I", the model intelligence level.
The OpenBSD SACK bug easily shows that: you can run an inferior model for an infinite number of tokens, and it will never realize(*) that the lack of validation of the start window, if put together with the integer overflow, then put together with the fact the branch where the node should never be NULL is entered regardless, will produce the bug.
So, cyber security of tomorrow will not be like proof of work in the sense of "more GPU wins"; instead, better models, and faster access to such models, will win.
* Don't trust who says that weak models can find the OpenBSD SACK bug. I tried it myself. What happens is that weak models hallucinate (sometimes causally hitting a real problem) that there is a lack of validation of the start of the window (which is in theory harmless because of the start < end validation) and the integer overflow problem without understanding why they, if put together, create an issue. It's just pattern matching of bug classes on code that looks may have a problem, totally lacking the true ability to understand the issue and write an exploit. Test it yourself, GPT 120B OSS is cheap and available.
BTW, this is why with this bug, the stronger the model you pick (but not enough to discover the true bug), the less likely it is it will claim there is a bug. Stronger models hallucinate less, so they can't see the problem in any side of the spectrum: the hallucination side of small models, and the real understanding side of Mythos.