Sentient 发布模型指纹排行榜 Fingerprinting Leaderboard
Good news for anyone trying to prove a model is theirs.
Sentient Foundation 发布开源基准 Fingerprinting Leaderboard,用于评测能证明 AI 模型被复制的指纹方法,测试代码 mlprints 同步开源。该榜单同时评估指纹抗移除能力、验证可靠性和对模型能力的损耗。Sentient 的 Perinucleus 方法在 Llama-3.1-8B 中嵌入 24,576 个指纹且未降低效用,并经受住标准微调。
查看原帖Models cost millions to train and minutes to copy. Fine-tuning and distillation can erase where they came from. Introducing the Fingerprinting Leaderboard, an open benchmark for model provenance — built so the proof lives in the weights, not the paperwork. https://t.co/aHONvNd7o4
正文
当前显示原文,中文全文译文尚未就绪。
Good news for anyone trying to prove a model is theirs.
Sentient Foundation released the Fingerprinting Leaderboard, a free, open source benchmark that tests fingerprinting methods, meant to prove an AI model was copied from yours.
Researchers submit a method for hiding an ownership mark inside a model, and Sentient puts that mark into its own test models, tries to strip it out, then ranks the method on a public website.
The code that runs these tests, called mlprints, is released too.
A fingerprint trains a model to return unlikely answers to secret prompts, so an owner can test a suspected copy through its API alone.
But a fingerprint that survives every attack is still useless if the owner can’t read it back reliably.
Sentient Foundation’s Fingerprinting Leaderboard scores that verification step directly, alongside how well the mark resists removal and how much model skill it costs.
Sentient’s Perinucleus method embedded 24,576 fingerprints in Llama-3.1-8B without degrading utility, is also competing on the leaderboard, and the fingerprints survived standard fine-tuning.