← AI crawlers
Google · Control token

Google-Extended

Google-Extended controls whether Gemini may use a site when answering questions. It does not affect Google Search.

THE FACTS
Operated by
Google
robots.txt token
Google-Extended
User-Agent sent
None — Google states this token is never sent as a User-Agent.
Honours robots.txt
Yes — Google documents that it honours robots.txt.
IF YOU BLOCK IT

This one is on the answer path.

Google uses it to decide whether Gemini can use your site when answering questions, so while it's blocked your pages can't be used in Gemini's answers. It does not affect Google Search.

THE EXACT LINES

Two lines in robots.txt.

Block Google-Extended

User-agent: Google-Extended
Disallow: /

Goes in the robots.txt at the root of your domain.

Allow Google-Extended

User-agent: Google-Extended
Allow: /

Only needed if a broader rule already blocks it — a group of its own overrides the wildcard.

Group selection matches the token, not the full User-Agent string, and it is case-insensitive. A rule under User-agent: * applies only when the crawler has no group of its own.

SOURCE

Everything on this page was read from Google’s own published source on . Read the source. Vendors change these pages without announcing it — if you find something here that no longer matches, tell us and we’ll correct it.

THE FULL REFERENCE

We run a crawler too. Here is what it does and how to block it.

CHECK YOUR OWN SITE

Knowing what Google-Extended does doesn’t tell you whether your site lets it in.

The free checker reads your robots.txt and asks your site for its homepage as each major AI crawler, then tells you which ones it turned away. No signup, about 20 seconds.