--- title: "Google-Extended and Gemini: real estate website controls" description: "Separate Gemini training and grounding choices from Google Search controls. Write an owner decision, inspect robots.txt, and test inquiry delivery." canonical: "https://scalewithsearch.com/articles/google-extended-gemini-agent-website-controls" --- ## Site navigation - [Scale With Search](https://scalewithsearch.com/) - Services - Services - [AI systems](https://scalewithsearch.com/ai-systems) - [Site build](https://scalewithsearch.com/work#site-build) - [Whole website fix](https://scalewithsearch.com/work#whole-website-fix) - [Content library with SEO](https://scalewithsearch.com/work#content-library) - [Working session](https://scalewithsearch.com/audit) - Start here - [Send your brief](https://scalewithsearch.com/work#send-your-brief) - [Example scope](https://scalewithsearch.com/work#review-the-example-scope) - [Prices and terms](https://scalewithsearch.com/work#prices-and-terms) - Industries - Real estate - [Real estate agents and teams](https://scalewithsearch.com/for/real-estate) - [Platforms, ownership, and IDX](https://scalewithsearch.com/for/real-estate/real-estate-website-platforms-ownership-idx) - [Search, content, and AI](https://scalewithsearch.com/for/real-estate/real-estate-search-content-ai) - [Inquiries, campaigns, and handoffs](https://scalewithsearch.com/for/real-estate/real-estate-website-inquiries-campaigns-handoffs) - [Buyer, seller, and local pages](https://scalewithsearch.com/for/real-estate/real-estate-buyer-seller-local-resources) - [Rules, privacy, and trust](https://scalewithsearch.com/for/real-estate/real-estate-website-rules-privacy-trust) - Browse by business - [Trades and home services](https://scalewithsearch.com/for/#group-trades) - [Health, wellness, and animal care](https://scalewithsearch.com/for/#group-practices) - [Law, finance, and IT](https://scalewithsearch.com/for/#group-professional) - [Marketing and SEO agencies](https://scalewithsearch.com/for/#group-agencies) - [Shops and manufacturers](https://scalewithsearch.com/for/#group-manufacturing) - [Restaurants, shops, studios, and nonprofits](https://scalewithsearch.com/for/#group-local-services) - Chiropractic practices - [Chiropractic and wellness practices](https://scalewithsearch.com/for/chiropractic-and-wellness-practices) - [Chiropractic and physical therapy clinics](https://scalewithsearch.com/for/chiropractic-and-physical-therapy-clinics) - [All industries](https://scalewithsearch.com/for/) - Resources - Free tools - [AI readiness check](https://scalewithsearch.com/check) - [Free tools](https://scalewithsearch.com/tools/) - [Free Starter Kit](https://scalewithsearch.com/kit/business-memory-starter-kit.zip) - Guides - [AI-native library](https://scalewithsearch.com/ai-native) - [Industry intelligence](https://scalewithsearch.com/intelligence) - [Office job guides](https://scalewithsearch.com/guides/) - [Business memory](https://scalewithsearch.com/articles/business-memory-for-ai-agents-guide) - [Agent governance](https://scalewithsearch.com/articles/ai-agent-governance-guide-small-business) - [Migration and ownership](https://scalewithsearch.com/articles/leaving-vendor-ai-memory-guide) - Articles - [All articles](https://scalewithsearch.com/articles/) - [What changed](https://scalewithsearch.com/changes/) - About - Evidence - [Proof](https://scalewithsearch.com/proof) - Scale With Search - [About](https://scalewithsearch.com/about) - [How it works](https://scalewithsearch.com/how-it-works) # Google-Extended: Gemini controls for your real estate website Use Google-Extended to manage the documented use of your website content for Gemini training and grounding. Its setting does not affect Google Search inclusion or ranking. Make the Gemini decision separately from your Search decision. [Google's Google-Extended specification, updated 2026.07.14 and checked 2026.10.14](https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers#google-extended). For a real estate website, start with your seller service page, buyer representation page, and public guides. Record which uses you want to permit. Then require the website maintainer to preserve the contact routes you depend on. Treat the following brief as a method for choosing and checking settings. It does not report an audit of your website. ## Separate the Gemini decision from the Search decision Google defines grounding as supplying Search-index content to a model when someone makes a request. Google-Extended covers that use in Gemini Apps and Grounding with Google Search on Vertex AI. It also covers training future Gemini generations powering Gemini Apps and the Vertex AI API. [Google's product scope, checked 2026.10.14](https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers#google-extended). The documented token covers training and grounding together. Do not request a Google-Extended setting that permits one while blocking the other. [Google's combined control](https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers#google-extended). Use this distinction when reviewing a contractor's proposal: | Owner decision | Documented control | Question to put in the brief | | --- | --- | --- | | Gemini training and grounding uses described above | `Google-Extended` in robots.txt | Which public paths should be permitted or restricted? [Google's Google-Extended specification, updated 2026.07.14 and](https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers#google-extended), checked 2026.10.14. | | Crawling for Google Search, including its AI features | `Googlebot` directives | Which pages should remain crawlable for Search? | | Information shown from pages in Search AI features | Preview and indexing controls | Is there a separate passage or page restriction to review? | Google names `nosnippet`, `data-nosnippet`, `max-snippet`, and `noindex` as Search controls. Google-Extended addresses some other Google systems. This distinction applies even when the Search feature uses AI. [Google's Search AI controls, updated 2025.12.10 and checked 2026.10.14](https://developers.google.com/search/docs/appearance/ai-features#control). Keep passage-level preview changes in their own task. Request a separate brief for the passage, wrapper boundaries, and Search checks. ## Record what the website owner is choosing Ask the person responsible for your website's public content to approve a specific decision. Avoid a vague instruction such as “block AI” or “make us visible in Gemini.” Choose the public pages first. For each page, record its URL, purpose, content owner, and proposed treatment. Include your own explanations of seller representation and buyer services. Identify vendor-hosted listing pages separately. Use this proposed decision record: | Field | Evidence or instruction to supply | | --- | --- | | Website addresses | Exact public hostnames and paths being considered. | | Approved choice | Permit or restrict the documented Google-Extended uses on those paths. | | Reason | The owner's stated reason, without inventing a traffic forecast. | | Search intention | Pages that should remain available for Google Search crawling. | | Separate restrictions | Existing preview controls or indexing instructions to review independently. | | Responsibility | Approver, implementer, and maintainer after handoff. | | Recovery | Original file and approved rollback procedure. | If the owner wants to prohibit the documented uses, specify that result. If the owner wants to permit them, record that choice just as clearly. Leave the decision unresolved until the responsible person chooses. Do not turn permission into a promise that Gemini will cite you. Require any proposed visibility benefit to come with evidence. Keep an observed answer separate from the owner's content-use preference. ## Give the maintainer a bounded robots.txt change For an approved site-wide restriction, this is the proposed Google-Extended group: ```text User-agent: Google-Extended Disallow: / ``` It uses Google's documented token and robots.txt path rules. Review it within the complete file before deployment. [Google's token](https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers#google-extended), [Google's robots.txt rules, updated 2025.11.21 and checked 2026.10.14](https://developers.google.com/crawling/docs/robots-txt/create-robots-txt). Have the maintainer show the original and proposed files side by side. Identify every changed line. Reject an unexplained expansion to the wildcard group or Googlebot rules. For a permitted path inside a restriction, ask for a path-specific proposal and expected results. Do not copy a directory name from another website. Use the URLs in your approved decision record. Google selects the most specific matching user-agent group. Matching groups for the same agent are combined; specific and wildcard groups are not combined. Review existing groups before adding another. [Google's group-selection specification, updated 2026.08.31 and checked 2026.10.14](https://developers.google.com/crawling/docs/robots-txt/robots-txt-spec#order-of-precedence-for-user-agents). Require a plain-text file at the host's root. Rules apply to their protocol, hostname, and port. An IDX page on another host needs its own review. [Google's file-location and scope requirements](https://developers.google.com/crawling/docs/robots-txt/create-robots-txt). Do not replace the entire file with the example above. Preserve existing decisions that the owner has not authorized you to change. ## Check the saved rule without inventing a crawler visit Google-Extended has no separate HTTP user-agent string. Existing Google crawler identities fetch the content; the token controls its documented uses. A missing “Google-Extended” entry in access logs is therefore not proof of failure. [Google's request-identity explanation](https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers#google-extended). After an authorized implementation, request a dated acceptance record containing the public robots.txt response and complete file. Compare it with the approved version. Include the status, final URL, and host being checked. Ask the maintainer to evaluate the rules against your exact seller page, buyer page, and selected guide URLs. Record the expected Google-Extended result for each. Evaluate Googlebot separately against the intended Search access. Treat parser output as a rule check. Do not label it a verified Google request or proof of model behavior. Retain unresolved provider-processing evidence as unresolved. For Search, a supporting page must be indexed and eligible for a snippet to qualify for AI Overviews or AI Mode. Qualification guarantees no inclusion. Use the Search checks for that purpose, rather than treating them as verification of Gemini's content use. [Google's AI-feature requirements](https://developers.google.com/search/docs/appearance/ai-features#technical-requirements-for-appearing-in-ai-features). If someone reports an unexpected AI answer, save the exact service, question, date, answer, and linked source. Distinguish Gemini Apps from AI Mode or AI Overviews. Inspect the cited address before assuming your changed page supplied the wording. ## Accept the website change beside a received inquiry The Google-Extended record separates your control decision from published rules and later answer observations. Submit the bounded page change at [whole website fix: Google-Extended controls](/for/real-estate). Ongoing answer tracking is excluded from the whole website fix. [Published scope, checked 2026.10.14](https://scalewithsearch.com/work). [Whole website fix exclusions](https://scalewithsearch.com/work). - [Test the seller inquiry path on your real estate website](/articles/seller-inquiry-path-agent-website) - [Check your real estate website in 30 minutes](/articles/real-estate-website-audit) - [Own your real estate website: domain, hosting, editing, and leads](/articles/own-your-site) ## Related: Real estate - [Test the seller inquiry path on your real estate website](/articles/seller-inquiry-path-agent-website) - [Check your real estate website in 30 minutes](/articles/real-estate-website-audit) - [Own your real estate website: domain, hosting, editing, and leads](/articles/own-your-site) ---- ```text .|########||. .|########||. .|########||. |##||. .||##|. |##||. .||##|. |##||. .||##|. |#|. .|#|. |#|. .|#|. |#|. .|#|. |#| |#| |#| |#| |#| |#| .#| |#. .#| |#. .#| |#. .#. .#| .#. .#| .#. .#| |#. .#| |#. .#| |#. .#| |# ...... #| |# ...... #| |# ...... #| .# ||#########| #| .# ||#########| #| .# ||#########| #| .#. |######||######|. .#. .#. |######||######|. .#. .#. |######||######|. .#. #. .##|###|##|#|######| .# #. .##|###|##|#|######| .# #. .##|###|##|#|######| .# || |##|#||||||||||||#||#| || || |##|#||||||||||||#||#| || || |##|#||||||||||||#||#| || # |#||||||||||||||||||||#| #. # |#||||||||||||||||||||#| #. # |#||||||||||||||||||||#| #. || |#||||||||||||||||||||||#| || || |#||||||||||||||||||||||#| || || |#||||||||||||||||||||||#| || # .#||||||||||||||||||||||||#| # # .#||||||||||||||||||||||||#| # # .#||||||||||||||||||||||||#| # || ....|||#||||||##|#|||#|#||##||||....|. || || ....|||#||||||##|#|||#|#||##||||....|. || || ....|||#||||||##|#|||#|#||##||||....|. || #. . ....|# ....#||| ||| .#||| ....#. .# #. . ....|# ....#||| ||| .#||| ....#. .# #. . ....|# ....#||| ||| .#||| ....#. .# # . ||||#| .#####|| . .#| .#||| ||||# #. # . ||||#| .#####|| . .#| .#||| ||||# #. # . ||||#| .#####|| . .#| .#||| ||||# #. .| ||||| #. |#|||||. || #. |#||. .||||| || .| ||||| #. |#|||||. || #. |#||. .||||| || .| ||||| #. |#|||||. || #. |#||. .||||| || || |.... #. ....|#. |. ...|. ....|| || || |.... #. ....|#. |. ...|. ....|| || || |.... #. ....|#. |. ...|. ....|| || #. .||||||##||||||##||####|||||||#||||||#| .# #. .||||||##||||||##||####|||||||#||||||#| .# #. .||||||##||||||##||####|||||||#||||||#| .# # .||####|###########################|. # # .||####|###########################|. # # .||####|###########################|. # # .#||||||.#.|| # |. ..# #| #|||||#| # # .#||||||.#.|| # |. ..# #| #|||||#| # # .#||||||.#.|| # |. ..# #| #|||||#| # # .#|||||| .. |# ## |#| ...#|#|||#| # # .#|||||| .. |# ## |#| ...#|#|||#| # # .#|||||| .. |# ## |#| ...#|#|||#| # # .#|||#|# .# .#| #| ##|.#..#|||||#| # # .#|||#|# .# .#| #| ##|.#..#|||||#| # # .#|||#|# .# .#| #| ##|.#..#|||||#| # # .#||||||############|######|||||#| # # .#||||||############|######|||||#| # # .#||||||############|######|||||#| # # |...||#||||||#||||#|#||||||#|||||#||| |.| # # |...||#||||||#||||#|#||||||#|||||#||| |.| # # |...||#||||||#||||#|#||||||#|||||#||| |.| # #. .. ||||# .|||##|. |#| .|| || .|||#. #| # .# #. .. ||||# .|||##|. |#| .|| || .|||#. #| # .# #. .. ||||# .|||##|. |#| .|| || .|||#. #| # .# || | ...|| ...##| | #| .|. |. ##### .. .| || || | ...|| ...##| | #| .|. |. ##### .. .| || || | ...|| ...##| | #| .|. |. ##### .. .| || || ||||| || ||||#| . |. |. |#. ||||| |#| || || || ||||| || ||||#| . |. |. |#. ||||| |#| || || || ||||| || ||||#| . |. |. |#. ||||| |#| || || .# |.....#|....|#.||||.|||##.|#|....||.#||.#. #. .# |.....#|....|#.||||.|||##.|#|....||.#||.#. #. .# |.....#|....|#.||||.|||##.|#|....||.#||.#. #. #.|||||||#############################| ||| .# #.|||||||#############################| ||| .# #.|||||||#############################| ||| .# || ##||#||#||||||#||#||#||#||##. || || ##||#||#||||||#||#||#||#||##. || || ##||#||#||||||#||#||#||#||##. || # .#|||||||||#||#|||||||||||#| # # .#|||||||||#||#|||||||||||#| # # .#|||||||||#||#|||||||||||#| # || |#||||||||||||||||||||||#| || || |#||||||||||||||||||||||#| || || |#||||||||||||||||||||||#| || .# |#||||||||||||||||||||#| #. .# |#||||||||||||||||||||#| #. .# |#||||||||||||||||||||#| #. || |#||||||||||||||||||#| || || |#||||||||||||||||||#| || || |#||||||||||||||||||#| || #. .######|#|#########| .# #. .######|#|#########| .# #. .######|#|#########| .# .#. |#####||||#####| .#. .#. |#####||||#####| .#. .#. |#####||||#####| .#. |# ||########|| #. |# ||########|| #. |# ||########|| #. |# ...... #| |# ...... #| |# ...... #| |#. .#| |#. .#| |#. .#| |#. .#. |#. .#. |#. .#. .#| |#. .#| |#. .#| |#. |#| |#| |#| |#| |#| |#| .|#|. .|#|. .|#|. .|#|. .|#|. .|#|. |##||. .||##| |##||. .||##| |##||. .||##| .||########||. .||########||. .||########||. Scale With Search 2026 [scalewithsearch.com](https://scalewithsearch.com) ```