AI Trends

AI-Generated Fakes Used to Harvest Traffic Must Be Severely Punished (Jintai Commentary)

People’s DailyUpdated Nov 19 06:18

AI summary

AI tools have dramatically reduced the cost of fabrication, giving rise to a gray industrial chain that harvests “toxic traffic” through false information, face-swapping and voice cloning, and impersonation-based product promotion. Governance efforts must increase the cost of breaking the law, reduce the profits from infringement, push platforms to proactively fulfill their duty of care, and use swift, precise enforcement to sever the chain of traffic monetization, while avoiding harm to legitimate innovation.

Body · AI translation

A meal for six costing 510,000 yuan, a bottle of liquor priced at 230,000 yuan... Recently, an “exorbitant liquor bill” sparked heated discussion online. Yet a police investigation found that it was in fact AI-fabricated “toxic traffic”: Seeking attention and higher sales, an online liquor retailer used AI software to alter the amounts on the bill and create a fake video, then operated accounts and hired others to post it, spreading it widely online.

As technology advances by leaps and bounds, some people are now turning to AI to generate “toxic traffic.” Some use AI to fabricate information and falsify images and videos, attracting traffic by spreading rumors; others use AI to swap faces, imitate voices, and impersonate celebrities to promote products and draw traffic, seriously infringing upon others’ portrait rights. In the past, doctoring an image or generating a convincing fake video required considerable technical expertise. Today, all kinds of AI tools are readily available, making “one-click fabrication” virtually cost-free. This has turned “toxic traffic” into a low-cost, high-return business supported by an industrial chain.

The most urgent task in combating “toxic traffic” is to correct the imbalance between the cost of breaking the law and the gains from infringement. Only by raising the costs and reducing the returns can the space for this business to survive be minimized.

In terms of legal liability, there is no shortage of “swords” hanging over the heads of those who use AI to create fakes. From penalties under the Public Security Administration Punishments Law for intentionally spreading rumors and severe punishment under the Criminal Law for acts such as extortion, to protections for reputation and portrait rights under the Civil Code, the law clearly demonstrates that cyberspace is not beyond its reach. In judicial practice, the Supreme People’s Court’s Opinions on Lawfully Adjudicating Cases Involving Artificial Intelligence Disputes clarify the principles for attributing liability in AI-related infringements and set out corresponding provisions for various scenarios involving the use of AI to violate personality rights, personal information rights and interests, and consumer rights and interests. As the legal net grows ever tighter, the next step is to implement these rules throughout platform governance, regulatory enforcement, and other areas.

As “gatekeepers,” platforms constitute a crucial line of defense and must shift from passive responses to proactive governance. Against the backdrop of deep integration between technology and business models, the traditional positioning of platforms as “technologically neutral” is undergoing profound change. Under models such as “free content plus advertising revenue” and “traffic generation plus commercial monetization,” platforms may not charge users directly, but they objectively attract traffic and increase user engagement through infringing content, thereby securing advertising revenue or commercial partnership opportunities. When platforms may profit directly from content distribution and algorithmic recommendations may themselves facilitate the spread of infringements, imposing a higher duty of care on platforms is no longer a “bonus question,” but a “required question.”

The rapid evolution of AI technology has placed greater demands on both law enforcement and the judiciary. Once infringements or illegal acts occur, accountability must keep pace with technological development. First, the response must be “fast”: violations should be promptly identified and tackled as soon as they emerge, eliminating the belief that traffic can be monetized with impunity. Second, enforcement must “hurt”: the gray industrial chain behind AI-fabricated “toxic traffic” must be severed and the conditions that nurture it eradicated. In addition, governance must be “precise”: while combating fabrication, it must also respect the boundaries of lawful creation and avoid inadvertently harming legitimate innovation.

As AI sharply reduces the cost of fabrication, the new task for enforcement and governance is to raise the price of creating fakes. From accelerating the formulation and improvement of relevant laws and regulations, policies and systems, application standards, and ethical guidelines, to establishing systems for technical monitoring, risk alerts, and emergency response, this challenge of fostering a clean and healthy cyberspace requires a collective response from society as a whole.

Source

People’s Daily