Skip to content
DriftCaught
GoogleNew version

gemini-3.1-pro-preview, gemini-3.1-pro-preview-customtools

New version, announced 19 February 2026. Rerun the suite: Run the Pro tier comparison against gemini-3.1-pro-preview, and keep the custom tools variant in a separate run so tool behaviour differences stay visible.

What Google says changed

Google released gemini-3.1-pro-preview and launched a gemini-3.1-pro-preview-customtools variant.

Google: Gemini API changelog

announced 2026-02-19 . verified 2026-09-22

This section restates the provider. It adds no judgement the provider did not make, and it contains no measurement of ours.

Entry

Provider
Google
Models
gemini-3.1-pro-preview, gemini-3.1-pro-preview-customtools
Change type
New version
Announced
2026-02-19
Verified
2026-09-22

What this kind of change typically touches

  • Agent

    A custom tools variant changes how the agent reaches its answer, not only what it answers. Future AGI describes scoring an agent at four resolutions, end to end, trajectory, step and turn, and writes that a high end to end score can hide bad tool calls, while strong per step scores can still miss that the agent pursued the wrong goal.

    Future AGI

What to do this week

Rerun the suite

Run the Pro tier comparison against gemini-3.1-pro-preview, and keep the custom tools variant in a separate run so tool behaviour differences stay visible.

If you are on a plan

A tracked provider update triggers a rerun of your suite within 2 business days of the announcement, and you get a written verdict. That is one of the six guarantees on every plan.

See plansRead EV-RERUN

Other Google changes

GoogleDeprecation

gemini-2.5-pro, gemini-2.5-flash

Google limited access to Gemini 2.5 models to projects that are actively using them. The entry points developers to Gemini 3.5 Flash-Lite or Gemini 3.8 Flash instead.

Plan a migrationCheck whether any project still calls a Gemini 2.5 model id, and open a migration ticket for the ones that do before new projects lose access.

Source: Google, Gemini API changelog . verified 2026-09-22

GoogleNew version

gemini-3.8-flash

Google released gemini-3.8-flash as generally available. The entry states it brings improvements for long horizon software engineering.

Rerun the suiteQueue gemini-3.8-flash into the next comparison run against the Flash model you use now, and record the result before moving traffic.

Source: Google, Gemini API changelog . verified 2026-09-22

GoogleNew version

gemini-3.7-flash

Google released gemini-3.7-flash. The entry states it brings substantial improvements across software engineering.

Rerun the suiteAdd gemini-3.7-flash to the comparison run you already schedule for Flash tier models, and note where its answers differ from the version you pin.

Source: Google, Gemini API changelog . verified 2026-09-22

Questions

How do I know this is accurate?
The entry links to Google's own page, and the date we read it is on this page. If the provider's page and this page disagree, the provider's page is right and we want to hear about it.
Does this mean my feature broke?
No. It means a thing your feature depends on changed. Whether anything about your output changed is a question only a rerun against your own dataset can answer, and that is what the recommended action is for.
Why is there no score or benchmark here?
Because we publish none. This site restates provider announcements and cites published practitioner guides. Any measurement we make belongs to the customer whose dataset produced it.

Sources

Change-log entries restate provider announcements with sources and dates. Impact notes cite public practitioner reports. The site publishes no measurements of its own on any model.

Related