AI News

Google launches the Gemini Decisions API, judging up to 1,000 questions per call with free output tokens

Phoenix TechnologyUpdated Nov 12 16:03

AI summary

Google has launched the Gemini Decisions API, which can be invoked through the Gemini Decision 1 model released the same day to make judgments on up to 1,000 preset questions at once. It supports text, image, audio, video, and PDF inputs and does not charge for output tokens. The model costs $0.1 per million input tokens, and Google says median end-to-end latency is 150 to 250 milliseconds for multimodal inputs of up to 16K tokens, at about one-fifth the cost of calling Gemini 3.5 Flash-Lite through the Interactions API. In a developer's test of 54 calls, all 30 customer service tickets and 8 multilingual tasks were classified correctly, and processing 100 questions in a single call took 0.41 seconds; however, when no fallback option is set, the model forces inputs beyond the preset scope into existing categories.

Why read this

SelectedAI score 77

The original article provides pricing, latency, and measured data, so readers can assess the cost and limits of this judgment-type API in classification and routing scenarios.

Topics

Tags

Body · AI translation

Free output? 100 questions in just 0.41 seconds! Google Gemini Decisions API goes live

Zhidongxi Download the app for exclusive early access November 12, 2026, 12:00:16 From Beijing

Zhidongxi, November 12 — Today, Google announced the launch of the Gemini Decisions API, which can be called through Gemini Decision 1, a model also released the same day. Unlike traditional generative models, Gemini Decision 1 can directly evaluate input content and make judgments on up to 1,000 preset questions at once. The model supports multimodal inputs including text, images, audio, video, and PDFs, and does not charge for output tokens.

On performance, Google says that with multimodal inputs of up to 16K tokens, Gemini Decision 1 has a median model compute latency of 50 to 100 milliseconds and an end-to-end latency of 150 to 250 milliseconds.

On pricing, Gemini Decision 1 charges $0.1 per million input tokens (about 0.67 yuan), with output tokens free, and its cost is about one-fifth of the cost of calling Gemini 3.5 Flash-Lite through the Interactions API.

After the API launch, netizens had mixed reactions. One user said: "All that hype for so long, and this is it? Still, I will definitely use it for routing. Having a chat model specially generate a whole paragraph just to answer yes or no has always felt like overkill to me. But this isn't all that innovative either; we've seen plenty of similar things."

Another user raised a practical question: "If none of the given options are correct, how will it answer? Overall, I'm glad to see this feature, especially since it supports multimodal input, which is very useful for my asset classification work."

Another user noted that the value of this API depends on actual speed performance: "If it really is faster than having an ordinary model make the judgment directly, then that's interesting. I'd rather get an answer in two seconds than wait for a long explanation I don't need at all."

On the same day, individual developer Lesia Kapliuk tested it using a free API key. The model correctly classified all 30 customer service tickets and 8 multilingual tasks across 54 calls, and processing 100 judgment questions in a single run took only 0.41 seconds, but Lesia found that the model forcibly assigns inputs beyond the preset range to existing categories.

Currently, the Gemini Decisions API is already used in Google internal products such as Gemini Notebook, and Google Search also uses it for security protection of Model Context Protocol (MCP) tools. Developers can obtain an API key through Google AI Studio and use the free API quota for prototype development.

1. Supports mixing three types of judgment methods, processing up to 1,000 questions per request

The Gemini Decisions API handles developer-predefined questions through three types of judgment methods: Yes/No, Multiple Choice, and Ordered Rubric, and these three methods can be mixed in the same request.

Yes/No is used to estimate the probability that a certain condition holds, and developers can also separately set description criteria for when the condition holds and when it does not. Multiple Choice supports 2 to 255 candidates; the model selects the option that best meets the requirements and returns a normalized probability for each candidate. Ordered Rubric evaluates the input content according to an ordered scale starting from 0, returning a weighted continuous score as well as the probability corresponding to each rating level.

All three judgment methods come with a confidence score between 0 and 1. Developers can set processing rules based on confidence, for example handing results the model cannot determine to a backup model, or escalating them to manual review.

In terms of multimodal processing, Gemini Decision 1 is based on Gemini's native multimodal architecture and can directly process text, images, audio, video, and PDF files in a single model computation. Different types of content can be combined in the same input, for example analyzing a call recording together with account information, or combining a PDF insurance claim document with on-site damage photos for judgment.

Developers can also adjust the resolution of images and videos to control the visual details the model needs to recognize and token consumption. A single request supports up to 256K tokens of input content, and up to 1,000 independent questions can be set for the same input.

Google also gave a practical application example. Developers can upload a photo of a breakroom counter along with a text description, letting the model simultaneously judge whether there is uncleaned liquid on the counter, which cleaning measure should be taken, and how dirty the scene is.

Among these, the model needs to judge whether there are liquid stains, choose among three actions — wiping the counter, arranging cleaning staff, and no action needed — and rate according to three levels: fully clean, minor localized stains, and severe stains or safety hazards. All three tasks can be completed in a single request.

Currently, multiple products within Google, including Gemini Notebook and Stitch, have integrated the Gemini Decisions API, using it as a low-latency decision control layer. Developers only need to predefine the judgment options to let the model complete task allocation, without additionally training a dedicated classifier or waiting for the generative model to output a complete answer.

In addition, Google Search also uses the Decisions API as a security protection layer for Model Context Protocol (MCP) tools, helping to identify adversarial behavior and related content, improving detection effectiveness while controlling response latency.

II. Response latency as low as 50 milliseconds, cost less than one-fifth of generative models

In terms of operating mechanism, Gemini Decision 1 differs from traditional generative models.

Traditional generative models usually need to generate tokens one by one and then combine them into a complete answer. Gemini Decision 1 instead directly scores the candidate options preset by developers, returning probabilities and confidence scores through a single forward model computation, without needing to generate answer tokens one by one.

Google says that in benchmarks covering agent routing, reasoning, ranking, and multimodal understanding, Gemini Decision 1 leads overall, and its calibration error is also the lowest among the APIs tested.

In multimodal input scenarios of up to 16K tokens, the model's median model computation latency is 50 to 100 milliseconds, and end-to-end latency is 150 to 250 milliseconds. When the number of questions in a single request increases from 1 to 100, response latency remains basically stable.

In terms of cost, because shared input in the same request is billed only once, when adding judgment questions, users only need to pay extra for the tokens consumed by the instructions and evaluation criteria corresponding to each question.

In benchmarks jointly conducted by both parties, compared with Gemini 3.5 Flash-Lite called through the Interactions API, the cost of Gemini Decision 1 with the Decisions API is nearly 80% lower, about one-fifth of Gemini 3.5 Flash-Lite.

Gemini 3.5 Flash-Lite charges $0.3 per million input tokens (about 2.01 yuan) and $2.5 per million output tokens (about 16.75 yuan).

Gemini Decision 1 charges $0.1 per million input tokens (about 0.67 yuan), with no output token fees, no additional thinking token fees, and no separate audio transcription and OCR text recognition fees.

In terms of call quotas, the Gemini Decisions API is divided into free and paid tiers.

The free version allows up to 200 requests per minute, processes up to 50,000 tokens per minute, and allows up to 10,000 requests per day.

The paid version charges $0.1 per million input tokens (about 0.67 yuan), with output tokens free. At the Tier 1 level, it allows up to 1,500 requests per minute, processes up to 1 million tokens per minute, and allows up to 50,000 requests per day.

III. Developer's actual test of 54 calls: 100 questions increase time consumption by 70%

Individual developer Lesia Kapliuk released actual API test results for Gemini Decision 1 on November 11. The developer made 54 calls using a free API key, testing the model's classification accuracy, multilingual processing capability, batch judgment efficiency, and result stability.

In actual testing, the developer submitted 30 customer service tickets and asked the model to assign the tickets to the corresponding teams; all 30 tickets were correctly classified. In multilingual testing, the model handled 8 tasks in languages including Ukrainian, German, Spanish, Polish, and Japanese, and also gave correct results for all of them.

In terms of batch processing, the developer tested cases with 1, 10, and 100 judgment questions in a single request. The results showed that when processing 1 question and 10 questions, the median response time was 0.24 seconds for both; after the number of questions increased to 100, the response time rose to 0.41 seconds, an increase of about 70%.

The corresponding token consumption also rose with the number of questions. Processing 1 question in a single request consumed 135 tokens, 10 questions consumed 613 tokens, and 100 questions consumed 5,473 tokens. In addition, when the same request was submitted 5 times repeatedly, the results and probabilities returned by the model were completely consistent.

This test also exposed a problem when the model handles abnormal input. When the input content does not meet the preset classification conditions, the model may still forcibly choose an existing option.

For example, the developer input the capital of Australia, meaningless random characters, and a passage requesting the creation of an autumn-themed poem, asking the model to judge whether these contents belong to customer service requests.

After the developer added "Other" to the candidate options, the model chose "Other" for all three inputs, with corresponding confidence scores of 0.99, 0.69, and 0.98.

However, when the "Other" option was not set, the model incorrectly classified all three items into the technical support category, with confidence scores reaching 0.71, 0.64, and 0.84, respectively. For the yes/no judgment of whether they belong to customer service requests, the probabilities given by the model were only 0.01, 0.07, and 0.01.

It can be seen that although Gemini Decision 1 can quickly handle judgment tasks within the preset scope, its results are still affected by the design of candidate options. If developers do not set a fallback option for abnormal input, the model may forcibly classify content that does not meet the classification conditions into existing categories.

Conclusion: Google extends model capabilities to fast decision-making scenarios

Judging from the positioning of the Gemini Decisions API, Google is trying to balance processing speed and call cost while remaining somewhat competitive.

For Agent applications that require frequent classification and tool selection, this type of API provides a new calling method. As Google internal products such as Gemini Notebook and Stitch are successively integrated, its application scenarios are also gradually expanding.

In the future, whether Gemini Decision 1 can continue to maintain stable judgment quality and processing efficiency in actual workflows will affect whether this type of API can form a long-term competitive advantage.

Source: Google

"Special statement: The above content (including videos, pictures, and audio if any) is uploaded and published by users of "Dafeng Hao," a self-media platform under Phoenix Net. This platform only provides information storage space services.

Notice: The content above (including the videos, pictures and audios if any) is uploaded and posted by the user of Dafeng Hao, which is a social media platform and merely provides information storage space services."

Source

Phoenix Technology