Meta’s Muse AI Reportedly Hit by Multiple Privacy Issues Involving Encrypted Messages and a Suspected Bank Balance
Meta employees reported that Muse AI accessed encrypted Signal messages without permission and showed one employee a bank balance that appeared to belong to another user. The AI Now Institute reproduced the unauthorized access to Signal messages; Meta called these “isolated incidents” and said the bank balance may have been a model hallucination. Muse has surpassed 10 million downloads.
Why read this
SelectedAI score 82
Multiple reports of unauthorized access to encrypted messages and suspected cross-user bank information offer concrete cases for assessing the privacy boundaries of personal AI agents.
Topics
Body
Meta employees have expressed concerns about what appear to be major privacy breaches when using Muse, currently the second most popular free iPhone app in the App Store with over 10 million downloads.
This includes again accessing end-to-end encrypted messaging without permission, and sharing what may be the bank balances of another Muse user …
Meta’s Muse AI
Siri AI was not the only AI app to launch back in September; Meta’s Muse AI app was launched the same month, with the company describing it as “your personal AI agent that gets things done across every part of life.”
Muse initially launched as an iPhone app, with Mac and iPad apps following shortly afterwards. It immediately moved to the top of the US App Store charts, overtaking ChatGPT. It quickly exceeded 5 million downloads following a major advertising push by Meta, and that number has since doubled.
Privacy concerns quickly raised
It wasn’t long before major privacy concerns were raised. Tech writer John Ternus reported that the Mac app accessed his messages despite him explicitly refusing permission. The app then lied to him about how it had achieved this. Meta described this as a bug.
Security researcher Patrick Wardle also discovered a zero-day vulnerability that could allow an attacker to hijack dictated prompts, directing them instead to their own server.
I said at the time that I would absolutely not be one of the millions of people using the app, and the wisdom of that decision has now been underlined by a fresh report.
Meta employees report privacy breaches
Reuters now reports Meta employees discussing further breaches. This includes another example of accessing encrypted messages without permission.
An employee using Muse on her personal phone reported it had surprised her with a reminder to respond to a message from her sister on Signal, an end-to-end encrypted messaging service popular with privacy advocates that competes with Meta’s WhatsApp.
“This seems like an extreme privacy violation. I definitely did not grant it access to other apps, or recall being asked about this,” the employee said in her post.
The report says this appears to have been done by capturing push notifications. However, this was what the app claimed had happened in the earlier case, and it turned out not to be true. The AI Now Institute was able to replicate the problem of Muse accessing Signal messages without permission.
Another employee reported receiving unsolicited bank balances that they say appeared to be those of another Muse user.
Muse had randomly added an extra message to its regular chats about fishing-related weather and tide information, saying: “BTW, two bank updates, your Capital One balance is $2722.58, your Charles Schwab balance is $5899.57.”
“I have never shared my bank account with Muse and never discussed any banking topic with Muse. I’m afraid it’s sending other’s bank info to me,” the staffer wrote in his post.
Meta told Reuters that these were “isolated incidents” and suggested that the bank balances may have been AI hallucinations rather than leaked information.
9to5Mac’s Take
I can only repeat my previous take on Muse: Nope.
meross Smart Garage Door Opener
Logitech MX Master 4 for Mac
Image: 9to5Mac/Meta/Public domain vectors
AI Trends