←新闻详情

Rohan Paul更新于 10月21日 22:46

White Circle 开源 RISE 图像模型红队工具

Good safety work increasingly means good search.

AI 导读

White Circle 开源了 RISE,一个用于测试 AI 图像生成器能否被绕过自身规则限制的自动化红队工具。它搜索针对图像模型的攻击策略,用一个开放的攻击模型把每种策略转成大量提示词,并按提示词突破数量给策略计分,从而在几乎拦截一切的模型上仍能持续学习。代码开源,所用模型公开,防御方可在自己的图像模型上运行。

推荐理由

AI 评分 65

原文给出 RISE 的搜索式红队思路与开源入口,读者可据此了解图像模型安全测试的一种可复用方法。

主题

标签

引用

White Circle

@whitecircle

We are open-sourcing RISE, our red-teaming algorithm that breaks the safeguards of the latest image models from OpenAI, DeepMind, and others. RISE uses readily available models like Qwen and Gemini Flash under the hood, with no additional training required. Read more: https://t.co/kt8ub0OmeW

查看原帖

正文

当前显示原文,中文全文译文尚未就绪。

Good safety work increasingly means good search.

White Circle’s released RISE, an automated tool for testing whether AI image generators can be tricked into making pictures their own rules forbid. It searches over attack strategies for image models. An open attacker model turns each strategy into many prompts, and the strategy gets credit for how many of them get through.

That keeps the search learning even against models that block almost everything.

The code is open, the models it uses are public, and defenders can run it on their own image models today.

来源

Rohan Paul