Gary Marcus：AI 智能体事故数量已升至数万起

Meanwhile, the US government appears to be paralyzed

Nope, wasn’t just Hugging Face.

Wasn’t just that and a German website.

Wasn’t even the “dozens” we heard about the other day from OpenAI.

It’s actually (at least) *tens of thousands*, per a new scoop from Madison Mills at Axios. And not just OpenAI, either.

An excerpt from the Axios scoop:

Most not known to have caused real-world harm. How about the others?

§

All of this seems possibly illegal to me.

But the Trump administration hasn’t done a thing. No investigation, no statement, no product recall, nothing, other than to invite Sam and Jensen to a state dinner.

Why I don’t know. I can’t imagine it has anything to do with Josh Kushner’s multibillion-dollar investment in OpenAI, or with Greg Brockman’s massive donations to MAGA.

I will let you connect your own dots.

Except to leave you with some perspective:

§

The other thing to note, and this may come up in lawsuits, is that it was all foreseeable. In fact, I foresaw it, in tweets like this:

and in a series of essays on agents, like this one from over a year ago:

LLMs + Coding Agents = Security Nightmare

Last October, I wrote an essay called “When it comes to security, LLMs are like Swiss cheese — and that’s going to cause huge problems” warning that “The more people use LLMs, the more trouble we are going to be in”. Until last week, when I went to Black Hat Las Vegas, I had no earthly idea how serious the problems were. There, I got to know Nathan Hami…

and this one from February (on a different agent that was then popular):

OpenClaw (a.k.a. Moltbot) is everywhere all at once, and a disaster waiting to happen

The big news in AI over the last week is OpenClaw (formerly known as Moltbot and before that OpenClaw, changing names thrice in a week) — a cascade of LLM agents that has become wildly popular — and Moltbook, a social network for AI agents, built on top. Theoretically (I will get to that) Moltbook “restricts posting and interaction privileges to verifie…

and this one from May:

Breaking: Autonomous Agents are a Shitshow

Remember my essay back in August with Nathan Hamiel LLM + Coding Agents = Security Nightmare?

Indeed I warned the Senate about agent-related security risks as far back as May 2023. What is happening was foreseeable, and foreseen.

But the companies blundered on, because agents use vastly more tokens than simple chatbots, and thus drive up revenue.

Now here we are.

§

I still think Jensen had the right idea: if a company can’t control its products, we should shut it down.

Pity he doesn’t actually appear to believe what he said. (If he did, he would call for a pause now, until these companies get themselves straight, but he isn’t.)

In my own view, Huang’s credibility is diminishing by the minute.

In any case—and I am sorry to be a broken record about this, but each day makes it clearer—we should have a temporary recall of general-purpose agents until this mess can be sorted out.

If we don’t, there is a very real chance that American AI will become the scourge of the planet, and that nobody will ever trust American AI, ever again.