AI crawlers
Google-Extended
A robots.txt name, not a crawler, that controls whether Google may use your pages to train Gemini and ground its answers. It has no effect on Google Search or AI Overviews.
Sources checked 14 November 2026
Google-Extended never visits your site. Googlebot fetches pages as usual, and Google-Extended is a name you put in robots.txt to say how those pages may be used for Gemini. Google's crawler documentation says it does not affect inclusion in Google Search and is not a ranking signal.
That covers AI Overviews and AI Mode, which are part of Search and follow your Googlebot rules and snippet settings. Blocking Google-Extended will not take you out of them.
14 of the 56 large sites we checked on 14 November 2026 block it.