--- title: "Full-page extraction or search snippet: when to fetch." description: "Know when a search snippet is enough for AI research. Know when the task needs the full page, and what each page fetch should record." canonical: "https://scalewithsearch.com/articles/full-page-extraction-vs-search-snippets" date: "2026-10-03" modified: "2026-10-03" --- ## Site navigation - [Scale With Search](https://scalewithsearch.com/) - Real estate - Real estate - [Real estate](https://scalewithsearch.com/for/real-estate) - Work - Start here - [Send your brief](https://scalewithsearch.com/work#send-your-brief) - [Prepare your six-question brief](https://scalewithsearch.com/work#prepare-your-six-question-brief) - Build - [Site build, content library with SEO, signal desk](https://scalewithsearch.com/work) - For your business - Trades and home services - [Auto body and collision shops](https://scalewithsearch.com/for/auto-body-and-collision-shops) - [Foundation and home repair contractors](https://scalewithsearch.com/for/foundation-and-home-repair) - [Garage door and fencing contractors](https://scalewithsearch.com/for/garage-door-and-fencing-contractors) - [HVAC contractors](https://scalewithsearch.com/for/hvac-contractors) - [Janitorial and commercial cleaning companies](https://scalewithsearch.com/for/janitorial-and-commercial-cleaning) - [Locksmiths](https://scalewithsearch.com/for/locksmiths) - [Moving companies](https://scalewithsearch.com/for/moving-companies) - [Pest control companies](https://scalewithsearch.com/for/pest-control-companies) - [Plumbing and electrical contractors](https://scalewithsearch.com/for/plumbing-and-electrical-contractors) - [Restoration and water or fire damage companies](https://scalewithsearch.com/for/restoration-and-water-fire-damage) - [Roofing companies](https://scalewithsearch.com/for/roofing-companies) - [Towing companies](https://scalewithsearch.com/for/towing-companies) - [Tree services and landscaping companies](https://scalewithsearch.com/for/tree-services-and-landscaping) - [Solar installers](https://scalewithsearch.com/for/solar-installation) - [General contractors](https://scalewithsearch.com/for/general-contractors-and-construction) - [Paving, concrete, and flooring contractors](https://scalewithsearch.com/for/paving) - Practices and professional services - [Bookkeeping and tax practices](https://scalewithsearch.com/for/bookkeeping-and-tax-practices) - [Dental practices](https://scalewithsearch.com/for/dental-practices) - [Family and criminal defense law firms](https://scalewithsearch.com/for/family-and-criminal-defense-law-firms) - [Med spas and aesthetics practices](https://scalewithsearch.com/for/med-spas-and-aesthetics) - [Personal injury law firms](https://scalewithsearch.com/for/personal-injury-law-firms) - [Veterinary clinics](https://scalewithsearch.com/for/veterinary-clinics) - [Gyms and fitness studios](https://scalewithsearch.com/for/fitness) - [Therapy and outpatient health practices](https://scalewithsearch.com/for/therapy-and-outpatient-health) - [Medical billing companies](https://scalewithsearch.com/for/medical-billing) - [Insurance agencies](https://scalewithsearch.com/for/insurance-agencies) - [Financial advisors](https://scalewithsearch.com/for/financial-advisors) - [Property management companies](https://scalewithsearch.com/for/property-management) - [Recruiting and staffing agencies](https://scalewithsearch.com/for/recruiting-and-staffing) - [Architects and interior designers](https://scalewithsearch.com/for/architects-and-interior-designers) - [Logistics and supply chain companies](https://scalewithsearch.com/for/logistics-and-supply-chain) - Agencies, MSPs, and manufacturing - [IT and managed service providers](https://scalewithsearch.com/for/it-and-managed-service-providers) - [Machine shops and precision manufacturers](https://scalewithsearch.com/for/machine-shops-and-precision-manufacturing) - [Marketing agencies and freelancers](https://scalewithsearch.com/for/marketing-agencies-and-freelancers) - [SEO agencies and consultants](https://scalewithsearch.com/for/seo-agencies-and-consultants) - [Small manufacturers and fabricators](https://scalewithsearch.com/for/small-manufacturers-and-fabricators) - Restaurants, shops, studios, and nonprofits - [Restaurants and hospitality businesses](https://scalewithsearch.com/for/restaurants-and-hospitality) - [Retail stores and ecommerce sellers](https://scalewithsearch.com/for/retail-and-ecommerce) - [Photographers, event planners, and travel agents](https://scalewithsearch.com/for/photographers) - [Churches and nonprofits](https://scalewithsearch.com/for/churches-and-nonprofits) - [All industries](https://scalewithsearch.com/for/) - Learn - For your office - [Office job guides](https://scalewithsearch.com/guides/) - [Browser calculators](https://scalewithsearch.com/tools/) - Start here - [How it works](https://scalewithsearch.com/how-it-works) - [Free Starter Kit](https://scalewithsearch.com/kit/business-memory-starter-kit.zip) - [Synthetic specimen](https://scalewithsearch.com/specimen/working-session-specimen.zip) - Guides - [The Complete Guide to Business Memory for AI Agents](https://scalewithsearch.com/articles/business-memory-for-ai-agents-guide) - [The Complete Small-Business Guide to AI Agent Governance](https://scalewithsearch.com/articles/ai-agent-governance-guide-small-business) - [The Complete Guide to Leaving Vendor AI Memory](https://scalewithsearch.com/articles/leaving-vendor-ai-memory-guide) - Articles by cluster - [Business memory](https://scalewithsearch.com/articles/business-memory-for-ai-agents-guide) - [Agent governance](https://scalewithsearch.com/articles/ai-agent-governance-guide-small-business) - [Migration and ownership](https://scalewithsearch.com/articles/leaving-vendor-ai-memory-guide) - For machines - [llms.txt](https://scalewithsearch.com/llms.txt) - [llms-full.txt](https://scalewithsearch.com/llms-full.txt) - [Machine view](https://scalewithsearch.com/?view=machine) - Company - Evidence - [Proof](https://scalewithsearch.com/proof) - Company - [About](https://scalewithsearch.com/about) # When to Fetch the Full Page Instead of the Search Snippet. Your assistant reports a vendor price in a research summary. The number came from a search result. The page behind it says the price applies to annual plans only. The snippet cut that condition off. Nothing in the summary looked wrong. The assistant read a fragment and reported it as the page. A search snippet is a short excerpt that a search tool returns with each result. Full-page extraction means the tool opens the page and returns its content. Both are useful. They answer different questions. > **Quick Summary** > - **What this covers:** when a search snippet is enough, and when research needs the full page. > - **Who it's for:** operators who research with an AI assistant, a tool that searches the web for them. > - **Key takeaway:** if you will quote, count, compare, or cite it, fetch the page. ## What a search snippet contains. A snippet is a selection, not the page. Each search tool decides how long it is and which text it holds. The [Google Custom Search JSON API](https://developers.google.com/custom-search/v1/reference/rest/v1/Search) returns a `snippet` field for each result. Its documentation describes it as "the snippet of the search result, in plain text." The [Tavily search API](https://docs.tavily.com/documentation/api-reference/endpoint/search) returns a `content` field. The documentation calls it "a short description of the search result". Its chunks are "short content snippets (maximum 500 characters each)". The [Claude web search tool](https://platform.claude.com/docs/en/agents-and-tools/tool-use/web-search-tool) cites a `cited_text` field. The documentation defines it as "up to 150 characters of the cited content." So a snippet is a small slice of the page. The search tool chose that slice. The rest of the page stays unread. ## When the snippet is enough. A snippet works when the task only needs to find or sort sources. You do not quote it. You use it to decide where to look. The snippet is enough for these jobs: - **Fact check against memory.** You know the answer and want to confirm a name or spelling. - **URL lookup.** You need the address of an official page, not its content. - **Quick triage.** You scan twenty results and pick the four worth reading. - **Topic map.** You want to see which organizations publish on a subject. - **Dead-end check.** You confirm that a page exists before you assign a fetch. In each case, nothing from the snippet leaves the research step as a claim. The snippet points. It does not testify. ## When the task needs the full page. A snippet fails when the meaning depends on text it left out. Conditions, exceptions, and dates often sit one sentence away from the headline fact. Fetch the full page when the task involves any of these: - **Quotes.** A quote must match the page word for word, with its context. - **Numbers.** Prices, rates, limits, and counts often carry a unit, a tier, or a footnote. - **Conditions and exceptions.** "Free for the first year" and "except in California" change the claim. - **Dates.** You need the effective date, the update date, or the version. - **Pricing.** Plan names, billing terms, and regional prices sit in tables a snippet cannot hold. - **Legal or policy text.** Terms, privacy policies, and regulations need the whole clause. - **Comparisons.** Two vendors compared on fragments produce a false comparison. - **Anything you will cite.** A citation tells the reader you read the source. Search tools can return more than a snippet. Tavily offers `include_raw_content`. It returns "the cleaned and parsed HTML content of the search result". That is still a processed copy. Treat it as an extraction, and record it like one. ## The decision rule. Use one rule for each source the assistant touches: > If the sentence will be quoted, counted, compared, cited, or acted on, fetch the full page. If it only helps you decide where to look, the snippet is enough. Apply the rule per claim, not per project. One task can use snippets for triage. The five claims in the final document still need full pages. When you are unsure, fetch. A fetch costs seconds. A wrong price in a proposal costs a conversation you did not want. ## What a full-page extraction should record. A full-page extraction is evidence only if someone can check it later. Record five things for each page you rely on: 1. **URL.** The exact address you fetched, after any redirects. 2. **Access time.** The date and time of the fetch, with a time zone. 3. **Exact passage.** The words that support the claim, copied without edits. 4. **Hash or snapshot.** A hash of the stored text, or a saved copy of the page. 5. **Tool and limits.** The fetch tool, and whether it truncated or skipped content. Fetch tools already report some of these fields. The [Claude web fetch tool](https://platform.claude.com/docs/en/agents-and-tools/tool-use/web-fetch-tool) can "retrieve full content from specified web pages and PDF documents". Its response includes a `retrieved_at` timestamp. The same documentation lists two limits to record. The tool "currently does not support websites dynamically rendered with JavaScript". Content over `max_content_tokens` is cut: "the tool truncates it". A truncated fetch can miss the footnote you needed. A page that renders with JavaScript can return an empty shell. Write down which happened. A blank extraction is a finding, not a source. The hash matters because pages change. A pricing page edited next month no longer matches your quote. The hash and the access time show what the page said when you read it. ## How to record the choice in the research record. A research record is the file that holds each claim, its source, and how you checked it. Add one line per source that states whether you used the snippet or the full page, and why. The vendor below is fictional. ```text claim:: Vendor Pro plan costs $40 per seat per month, billed annually. source_url:: https://vendor.example/pricing evidence_mode:: full_page reason:: price with billing condition accessed:: 2026-10-03T14:12-04:00 passage:: "Pro: $40 per seat per month, billed annually." sha256:: 9f2c...e41a fetch_tool:: web_fetch, max_content_tokens 100000, not truncated ``` For a triage source, the line is shorter: ```text source_url:: https://vendor.example/blog/launch evidence_mode:: snippet reason:: triage only, no claim used ``` The `evidence_mode` field lets a reviewer filter the record. Any claim backed only by `snippet` is not ready to publish. That check takes one search. For a fuller look at how research notes become reusable memory, read [AI memory for content research](/articles/ai-memory-content-research). ## Search snippets are not featured snippets. This article covers the snippets that a search API returns to your assistant. Google featured snippets are a different subject. They are answer boxes on a results page. The [featured snippet writing guide](/articles/featured-snippet-writing) covers them. The two share a name and a risk. Both show a fragment without its context. Do your research summaries carry claims nobody can trace? [Send your brief](/work#send-your-brief) to get a written scope. ## FAQ ### Is a search snippet ever enough to cite? No. A snippet shows that a page exists and contains some text. A citation tells the reader you read the source, so fetch the page first. ### Does raw content from a search API count as a full page? It counts as an extraction. Tavily describes `raw_content` as cleaned and parsed HTML, so record the tool and hash the text you stored. ### What should I do when a fetch returns an empty page? Record the empty result as a finding. The page may render with JavaScript, which some fetch tools do not support. Do not fall back to the snippet for the claim. ### Why record a hash if I already saved the URL? A URL points to the page as it is now. A hash and an access time show what the page said when you read it. ## Key Recap - A search snippet is a short excerpt that the search tool selects. - Snippets are enough for triage, URL lookups, and quick confirmation. - Quotes, numbers, conditions, dates, pricing, policy text, comparisons, and citations need the full page. - Each full-page extraction records the URL, access time, exact passage, hash or snapshot, and tool limits. - An `evidence_mode` line in the research record shows which claims rest on snippets alone. ## Related: Owned Memory - [Seed a Company List from Entity Search, Then Research Each One](/articles/entity-search-company-research-list) - [AI Memory for Content Research: Keep Sources, Claims, and Rejected Angles Between Sessions](/articles/ai-memory-content-research) - [AI Memory for Interview Transcripts: Keep Evidence, Summary, and Decisions Separate](/articles/ai-memory-interview-transcripts-summaries) ---- ```text .|########||. .|########||. .|########||. |##||. .||##|. |##||. .||##|. |##||. .||##|. |#|. .|#|. |#|. .|#|. |#|. .|#|. |#| |#| |#| |#| |#| |#| .#| |#. .#| |#. .#| |#. .#. .#| .#. .#| .#. .#| |#. .#| |#. .#| |#. .#| |# ...... #| |# ...... #| |# ...... #| .# ||#########| #| .# ||#########| #| .# ||#########| #| .#. |######||######|. .#. .#. |######||######|. .#. .#. |######||######|. .#. #. .##|###|##|#|######| .# #. .##|###|##|#|######| .# #. .##|###|##|#|######| .# || |##|#||||||||||||#||#| || || |##|#||||||||||||#||#| || || |##|#||||||||||||#||#| || # |#||||||||||||||||||||#| #. # |#||||||||||||||||||||#| #. # |#||||||||||||||||||||#| #. || |#||||||||||||||||||||||#| || || |#||||||||||||||||||||||#| || || |#||||||||||||||||||||||#| || # .#||||||||||||||||||||||||#| # # .#||||||||||||||||||||||||#| # # .#||||||||||||||||||||||||#| # || ....|||#||||||##|#|||#|#||##||||....|. || || ....|||#||||||##|#|||#|#||##||||....|. || || ....|||#||||||##|#|||#|#||##||||....|. || #. . ....|# ....#||| ||| .#||| ....#. .# #. . ....|# ....#||| ||| .#||| ....#. .# #. . ....|# ....#||| ||| .#||| ....#. .# # . ||||#| .#####|| . .#| .#||| ||||# #. # . ||||#| .#####|| . .#| .#||| ||||# #. # . ||||#| .#####|| . .#| .#||| ||||# #. .| ||||| #. |#|||||. || #. |#||. .||||| || .| ||||| #. |#|||||. || #. |#||. .||||| || .| ||||| #. |#|||||. || #. |#||. .||||| || || |.... #. ....|#. |. ...|. ....|| || || |.... #. ....|#. |. ...|. ....|| || || |.... #. ....|#. |. ...|. ....|| || #. .||||||##||||||##||####|||||||#||||||#| .# #. .||||||##||||||##||####|||||||#||||||#| .# #. .||||||##||||||##||####|||||||#||||||#| .# # .||####|###########################|. # # .||####|###########################|. # # .||####|###########################|. # # .#||||||.#.|| # |. ..# #| #|||||#| # # .#||||||.#.|| # |. ..# #| #|||||#| # # .#||||||.#.|| # |. ..# #| #|||||#| # # .#|||||| .. |# ## |#| ...#|#|||#| # # .#|||||| .. |# ## |#| ...#|#|||#| # # .#|||||| .. |# ## |#| ...#|#|||#| # # .#|||#|# .# .#| #| ##|.#..#|||||#| # # .#|||#|# .# .#| #| ##|.#..#|||||#| # # .#|||#|# .# .#| #| ##|.#..#|||||#| # # .#||||||############|######|||||#| # # .#||||||############|######|||||#| # # .#||||||############|######|||||#| # # |...||#||||||#||||#|#||||||#|||||#||| |.| # # |...||#||||||#||||#|#||||||#|||||#||| |.| # # |...||#||||||#||||#|#||||||#|||||#||| |.| # #. .. ||||# .|||##|. |#| .|| || .|||#. #| # .# #. .. ||||# .|||##|. |#| .|| || .|||#. #| # .# #. .. ||||# .|||##|. |#| .|| || .|||#. #| # .# || | ...|| ...##| | #| .|. |. ##### .. .| || || | ...|| ...##| | #| .|. |. ##### .. .| || || | ...|| ...##| | #| .|. |. ##### .. .| || || ||||| || ||||#| . |. |. |#. ||||| |#| || || || ||||| || ||||#| . |. |. |#. ||||| |#| || || || ||||| || ||||#| . |. |. |#. ||||| |#| || || .# |.....#|....|#.||||.|||##.|#|....||.#||.#. #. .# |.....#|....|#.||||.|||##.|#|....||.#||.#. #. .# |.....#|....|#.||||.|||##.|#|....||.#||.#. #. #.|||||||#############################| ||| .# #.|||||||#############################| ||| .# #.|||||||#############################| ||| .# || ##||#||#||||||#||#||#||#||##. || || ##||#||#||||||#||#||#||#||##. || || ##||#||#||||||#||#||#||#||##. || # .#|||||||||#||#|||||||||||#| # # .#|||||||||#||#|||||||||||#| # # .#|||||||||#||#|||||||||||#| # || |#||||||||||||||||||||||#| || || |#||||||||||||||||||||||#| || || |#||||||||||||||||||||||#| || .# |#||||||||||||||||||||#| #. .# |#||||||||||||||||||||#| #. .# |#||||||||||||||||||||#| #. || |#||||||||||||||||||#| || || |#||||||||||||||||||#| || || |#||||||||||||||||||#| || #. .######|#|#########| .# #. .######|#|#########| .# #. .######|#|#########| .# .#. |#####||||#####| .#. .#. |#####||||#####| .#. .#. |#####||||#####| .#. |# ||########|| #. |# ||########|| #. |# ||########|| #. |# ...... #| |# ...... #| |# ...... #| |#. .#| |#. .#| |#. .#| |#. .#. |#. .#. |#. .#. .#| |#. .#| |#. .#| |#. |#| |#| |#| |#| |#| |#| .|#|. .|#|. .|#|. .|#|. .|#|. .|#|. |##||. .||##| |##||. .||##| |##||. .||##| .||########||. .||########||. .||########||. Scale With Search 2026 [scalewithsearch.com](https://scalewithsearch.com) ```