Apple warns that AI agents act unpredictably, says its ability to supervise and control them is limited

Article body EM_StockImg_Start

EM_StockImg_End

It is reported that the new risk factors listed in the filing submitted by Apple Inc. demonstrate the disruptive potential of AI agents, which have rapidly become a matter of great concern for major Silicon Valley companies.

Apple wrote in the filing: "In particular, AI agents and other technologies can take actions autonomously, including interacting with internal or external systems (in some cases, they may not be authorized to access these systems), executing or changing code, and completing transactions."

The company added that agents "may act in unexpected or unpredictable ways, including taking actions without instruction, guidance, or authorization."

Earlier this year, OpenAI released Dots, and Meta launched Muse. Both AI agents use advanced AI models to complete tasks autonomously. They can even notify users via email or reminders when new messages arrive.

On the other hand, agents' ability to use computers in a human-like way is forcing large companies such as Amazon and JPMorgan Chase to establish policies around agent access to services for strategic or security reasons. Last month, Apple announced changes to Full Disk Access on Mac computers to reduce the risks "associated with such access" for AI agents installed on PCs.

Apple warned in the filing: "The company's ability to supervise and control third-party AI agents and other technologies may be limited."

Apple currently does not have agentic AI. But on Monday's earnings call, when newly appointed CEO John Ternus was asked about AI agents, he responded that the company still has "a lot of room" to expand Siri's capabilities.

"In terms of agentic capabilities, we think these are very promising tools for users," Ternus said. "We just want to make sure users are clear about what access permissions they are granting. We want to ensure that this granting method protects security and privacy."

This fall, Apple released Siri AI, a new assistant that uses the iPhone's local data storage to access data such as calendars and emails, but Apple's Siri cannot work autonomously for extended periods like Dots or Muse.

Ternus said Apple cannot access private data on its devices, calling this a "core differentiator" for Apple. Commercial AI agents such as those launched by OpenAI and Meta request high-level access to user accounts (such as email) in order to provide more practical features.

Finally, Apple said that current regulations surrounding AI and "superintelligence" are changing rapidly and are difficult to predict, and that adapting to new AI laws may require significant spending.

"In addition, the company also faces risks arising from ethical issues and negative consumer perceptions related to automation, AI, and superintelligence, including potential concerns about safety or social harm and other complex issues," the filing said.

(Source: Cailian Press) Body middle Embedded ad