AI Trends

Google Gemini can call merchants on users' behalf and complete purchases in the US

ThurrottUpdated Nov 18 03:52

AI summary

Google has added agentic features to Gemini. US users can have Gemini make phone calls to book appointments and check Google Calendar, and it can also find products within a budget, compare prices, and complete purchases via Google Pay. Gemini uses Google Cloud's Agent Compute Engine sandbox to execute tasks, requests confirmation before sensitive operations, and identifies itself as an AI when calling merchants, who can opt out of such automated calls. Users in the US, Japan, South Korea, Canada, Australia, and India will see Chat and Task buttons below the search bar, and US users can also initiate tasks with Gemini via email or text message.

Why read this

SelectedAI score 80

The original text lays out the specific boundaries of Gemini making calls, placing orders, and checking out via Google Pay, which can be used to judge the available scope of agent-run errands.

Topics

Tags

Body

Google is continuing to add new agentic features to its Gemini chatbot, which can now make phone calls and check out with Google Pay for users in the US. In the US, Japan, Korea, Canada, Australia, and India, Gemini will now show Chat and Task buttons below the search bar.

Increasingly, Google is positioning Gemini as the obvious choice of AI assistant for people who are already heavily invested in the Google ecosystem. It also helps that the Gemini app is preinstalled on Android, and Google Search users are also getting a taste of Gemini through the new AI Overviews and AI Mode.

“If your emails, calendar, passwords, photos, files, and payment cards are already in the Google ecosystem, Gemini is your best choice as a personal assistant because this sensitive data already lives at Google securely, and you don’t have to send it elsewhere,” Josh Woodward, Vice President, Labs, Gemini app, and AI Studio. While optional, Google’s Personal Intelligence feature allows Gemini to connect the dots and provide personalized answers using data from other Google services.

When assigning Gemini a task, the chatbot will use Google Cloud’s Agent Compute Engine, which works as a sandboxed virtual machine with protections against prompt injection attacks and harmful links. While Gemini can now access Google’s Password Manager to sign in securely on websites with users’ permission, the AI assistant will always ask for confirmation before performing sensitive actions, such as clicking a “Buy” button.

“While we’ve tested tasks extensively to minimize mistakes, we haven’t eliminated all of them. You may encounter situations where a task fails to complete or misses the mark,” Woodward warned today.

Outside of the Gemini app, Google is also making it possible to ask Gemini to start new tasks by forwarding it emails to [email protected], or sending it text messages. This is currently only available in the US, and Gemini users still need to verify their phone number in the app before being able to text with Gemini in Google Messages and iMessage.

In the US, Google Gemini can now call businesses on users’ behalf and book appointments at the most appropriate time by checking Google Calendar information. Google says Gemini will disclose right away that it’s an AI when it’s calling businesses, which can also opt out of these automated calls on behalf of customers.

Google is also improving Gemini’s agentic commerce capabilities by making it capable of searching for items based on a specific budget, finding the best prices online, and completing purchases using the new Google Pay integration. “All of your receipts and tracking info land straight in Google Wallet, which is expanding to iOS starting today. Up next, we’ll integrate the Universal Commerce Protocol (UCP) into Gemini so everyone can expect an even faster and more reliable shopping experience from discovery to checkout,” Woodward said today.

If you’re interested in checking out the new Google Wallet app for iOS mentioned by Woodward, it’s currently only available in the US, and it doesn’t support tap-to-pay functionality at the moment. However, you can use it to digitize physical cards, manage payment cards linked to your Google account, and keep track of agentic purchases.

There are two other Gemini updates worth mentioning today: 66 new regional voices are now available in the Gemini app, and Google also introduced a new option to keep your history in the chatbot while preventing Google from using chat content to train its generative AI models.

Source

Thurrott