←新闻详情

The Register更新于 10月25日 00:40

Opposable 推出用 AI 代操作手机的智能体工具,改个深色模式要 50 秒、17 次工具调用

Reach new heights of laziness by burning tokens to let an AI tap your smartphone screen for you

AI 导读

Opposable 推出一款让 AI 智能体代用户点击、滑动和输入 Android 手机屏幕的工具,iPhone 需借助配套电脑控制。其视觉处理由 GUI-Owl 1.5 2B 模型经 llama.cpp 完成,约 40 项常见任务仍走固定代码。官方示例中,用 Claude Code 经 MCP 切换深色模式并设 5 分钟计时耗时 50 秒、17 次工具调用,查询 Apollo 11 信息耗时近 2 分钟、花费 $0.44;在 8 项未调优任务上仅成功 4 次和 3 次。

正文

当前显示原文,中文全文译文尚未就绪。

ai and ml

Reach new heights of laziness by burning tokens to let an AI tap your smartphone screen for you

Nothing will ruin your faith in humanity like an AI that operates your smartphone slowly, struggles with basic tasks, and can charge you for it

Brandon Vigliarolo

GOVERNMENT AND IT NEWS REPORTER

Published wed 21 Oct 2026 // 21:13 UTC

Make us preferred on Google

Signal bug could keep your mic - and camera - on after hangup 4 hours ago

AI cuts coding time, but it's also filling open source's inbox with crap 8 hours ago

The spec is the new code, so brush up on your prose, says Kaseya CTO 11 hours ago

openEuler brings China's enterprise Linux ambitions to the desktop 1 day ago

Enterprises blow nearly a third of software budgets on upgrades they never asked for 1 day ago

Why use your smartphone when AI can do it for you? We’ve reached a new level of AI inanity with the launch of Opposable, a tool that taps, swipes, and types on Android phones and controls iPhones through a companion computer, sparing users the apparent burden of operating their own devices.

If you don't want to update a calendar event, start a timer, or enable dark mode, you can apparently use an AI agent app on your computer (any client that supports MCP will do) to have Opposable do the thing for you on a connected phone.

You could just do it on your computer, of course, but that’d require actually using your hands - like it’s some sort of baby’s toy. Lame. REG AD

Opposable describes the purpose of its app as being to “give your AI thumbs” that allow an agent to open apps, read the screen, tap, and type, all while signed in to a device as the person too lazy to use a super-convenient technology themselves. REG AD

As described in a blog post published by its creators Wednesday, Opposable's developers explain that its Android implementation uses accessibility services to inspect the screen, while screenshots provide visual input for an AI model. The model then decodes the images and figures out where it needs to tap on the screen in order to do whatever its user asked of it.

The visual processing is handled by a vision-language model known as GUI-Owl 1.5 2B, running through llama.cpp, while tasks can be handled by either a paired desktop AI agent or an on-device agent that works without a desktop connection (the latter is available only on Android devices – iPhones require a companion computer, with a Mac beta available and a hardware-assisted Windows/Linux option also advertised).

Even then, AI isn’t used for everything, with around 40 common tasks (setting an alarm, sending a text, switching Wi-Fi on or off) running as fixed code without an AI model involved.

Opposable doesn’t appear to be particularly fast, however, and its accuracy is questionable too. Opposable’s website includes three different examples of tasks executed using its product, and none seem to merit using an AI over, you know, human hands.

In one example, Claude Code over MCP is used to change the system’s theme to dark mode and then set a five-minute timer. This takes 50 seconds and requires 17 tool calls. In a second example using Claude Code and MCP, Opposable is asked to look up when Apollo 11 launched and who was on board, which takes just shy of 2 minutes. The number of tool calls isn’t mentioned, but the run cost is $0.44, which seems ridiculous when you can use your hands and figure it out for free. Hell, just asking Gemini or Siri right on a smartphone would return the answer faster and cheaper.

Those half-a-buck requests to Opposable could add up pretty quickly if you’re lazy enough to justify its use.

A third example shows a virtual Android device operating without a paired desktop agent, instead relying on the on-device agent that Opposable installs on Android phones. Opening the clock app and switching to the stopwatch tab takes it about 96 seconds, which is supposed to be impressive, apparently, as the company behind Opposable decided to showcase it on the thing’s website.

As for Opposable’s ability to actually accomplish tasks, well, that’s not exactly a sure thing. REG AD

“On eight tasks the model had never been tuned on, run on the emulator twice each, giving it the whole task succeeded 4 and 3 times,” the blog post notes. I’m pretty sure my brain and hands can do better without burning tokens to fail.

“Giving it one subgoal at a time and checking each claimed success against the accessibility tree before the next subgoal succeeded 6 times in both rounds,” the blog continues - so even when it gets babysat each step of the way, it still only succeeds at three-quarters of tasks. Cool - that’s really going to free up all that time wasted setting timers and doing other mundane tasks on my handset.

Why someone would install this on their Android device - which requires sideloading an APK and manually granting access to read and interact with the screen through accessibility settings - seems like a bit of a mystery. Opposable’s website even warns that it could be a security disaster: “whoever holds the token can operate the phone, so treat it like a password,” but still invites users to try.

An argument could be made for using Opposable as an accessibility tool for people with difficulty using a smartphone, but this isn’t mentioned anywhere on its website. Opposable is instead billed as a way to “hand off the phone chores,” leaving users free to do something else - just not on the phone currently being slowly controlled by a clumsy AI.

Sure, you could give your AI some virtual thumbs through Opposable, but … why? We reached out to the Opposable team to get an answer to that question, but didn’t hear back. ®

ai and ml software smartphone agentic ai

Make us preferred on Google

来源

The Register