--- title: "Technical SEO Services: Crawl, Index, Render, in Writing." description: "Technical SEO services from one technical SEO consultant: crawler access, index status, rendering, redirects, site migration SEO, AI crawler rules." canonical: "https://scalewithsearch.com/seo/technical-seo" --- ## Site navigation - [Scale With Search](https://scalewithsearch.com/) - Services - Website and search - [SEO solutions](https://scalewithsearch.com/seo) - [Technical SEO](https://scalewithsearch.com/seo/technical-seo) - [On-page and content SEO](https://scalewithsearch.com/seo/on-page-and-content-seo) - [Semantic SEO and topical authority](https://scalewithsearch.com/seo/semantic-seo-and-topical-authority) - [Custom SEO tools](https://scalewithsearch.com/seo/custom-seo-tools) - [Site build](https://scalewithsearch.com/work#site-build) - [Whole website fix](https://scalewithsearch.com/work#whole-website-fix) - One AI function - [AI operations](https://scalewithsearch.com/ai-systems) - Preparation - [Working session](https://scalewithsearch.com/audit) - Start here - [Send your brief](https://scalewithsearch.com/work#send-your-brief) - [Example scope](https://scalewithsearch.com/work#review-the-example-scope) - [Prices and terms](https://scalewithsearch.com/work#prices-and-terms) - Industries - Agencies - [SEO agencies and consultants](https://scalewithsearch.com/for/seo-agencies-and-consultants) - [Marketing agencies and freelancers](https://scalewithsearch.com/for/marketing-agencies-and-freelancers) - [AI check for SEO agencies](https://scalewithsearch.com/check/seo-agencies-and-consultants) - [All agency pages](https://scalewithsearch.com/for/#group-agencies) - Browse by business - [Trades and home services](https://scalewithsearch.com/for/#group-trades) - [Real estate agents and teams](https://scalewithsearch.com/for/real-estate) - [Health, wellness, and animal care](https://scalewithsearch.com/for/#group-practices) - [Chiropractic and wellness practices](https://scalewithsearch.com/for/chiropractic-and-wellness-practices) - [Law, finance, and IT](https://scalewithsearch.com/for/#group-professional) - [Shops and manufacturers](https://scalewithsearch.com/for/#group-manufacturing) - [Restaurants, shops, studios, and nonprofits](https://scalewithsearch.com/for/#group-local-services) - [All industries](https://scalewithsearch.com/for/) - Resources - Free tools - [AI readiness check](https://scalewithsearch.com/check) - [Free tools](https://scalewithsearch.com/tools/) - [Free Starter Kit](https://scalewithsearch.com/kit/business-memory-starter-kit.zip) - Guides - [AI-native library](https://scalewithsearch.com/ai-native) - [Industry intelligence](https://scalewithsearch.com/intelligence) - [Office job guides](https://scalewithsearch.com/guides/) - [Business memory](https://scalewithsearch.com/articles/business-memory-for-ai-agents-guide) - [Agent governance](https://scalewithsearch.com/articles/ai-agent-governance-guide-small-business) - [Migration and ownership](https://scalewithsearch.com/articles/leaving-vendor-ai-memory-guide) - Articles - [All articles](https://scalewithsearch.com/articles/) - About - Evidence - [Proof](https://scalewithsearch.com/proof) - Scale With Search - [About](https://scalewithsearch.com/about) - [How it works](https://scalewithsearch.com/how-it-works) # Technical SEO Services That Start With What the Crawler Actually Got. Technical SEO services here begin with one question: what did Google, ChatGPT, and the AI crawlers receive when they asked for your pages? Not what your logs say they sent. What arrived, rendered, and got indexed. One technical SEO consultant runs the audit, writes the scope, and reviews every fix. AI agents I run do the crawls, the log reads, and the first pass on every ticket. One-time scope or monthly. The price is set per site, and this page names what sets it. [Send your brief](/work#send-your-brief) ## The problem first: the site passes its own checks and still loses pages. The logs say 200. The developer's tests pass. URL inspection says the page is fine. The traffic is gone. This happens after a platform change, a migration, a new firewall rule, a maintenance window where someone blocked crawlers and never unblocked them, or a template that puts the answer behind a script the crawler stops waiting for. Each of these leaves a clean log and a missing page. The fix is not another crawl of your site with a desktop tool. It is comparing what your crawler finds with what the engines fetch, confirming index status in the engines' own consoles, and reading the rendered page as the crawler read it. ## What a technical SEO audit covers here. - Crawler access: firewall and CDN bot rules, robots.txt, status codes, and the rules that apply to AI crawlers. - Index status: which pages are indexed in Google Search Console and Bing Webmaster Tools, which are excluded and why, and whether noindex and robots meta tags match what you intended. - URL patterns: parameters, facets, pagination, alternates, and historical URLs the engines still fetch; near-identical pages and the keeper for each set. - Rendering: the rendered HTML against the source for each template, the resources it waits for, and whether the answer sits in the first screen of HTML. - Response time, the HTTPS redirect, and the TLS handshake as a crawler sees them. - Redirects: chains, loops, downgrades, and the map for any merge or removal. - Sitemaps and IndexNow: accurate lastmod, no retired URLs, a publish hook that tells the engines. - Bot verification in logs, so counts use verified crawlers and name the layer they came from. - Schema: the structured data on each template, validated and matched to the visible page. ## Site migration SEO, as its own scope. A migration is the technical job most likely to lose pages. The scope for site migration SEO covers the URL inventory, the redirect map with a keeper for every retired URL, the pre-launch crawl of staging, the launch-day check of status codes and index status, and the thirty-day watch afterward. Removed pages can keep getting cited by AI answers after they are gone, so each retired URL gets a documented disposition: a redirect to a relevant replacement when one exists, or a 404 or 410 when the content is removed with no replacement. ## AI crawler rules, written down. Every site now needs a stated policy for AI crawlers: which bots may crawl, which may use the content for training, which may use it to ground answers, and which pages are excluded. Crawler and usage controls differ by provider. I record the documented directives, their effective dates, and any transition requirements before changing them. A block on training is not retroactive, and one crawl can serve both search and training at some vendors. The policy goes in robots.txt, on the page, and in your scope so nobody has to guess later. The free [robots.txt builder](/tools/robots-txt-builder) shows the directives; the scope decides them. ## What you get. The audit as a file you own, with each finding carrying the URL, the evidence, the fix, and the re-test. A ticket per change, written so your developer can apply it without a call, or applied by me with access. The redirect map. The crawler policy. A before-and-after record of index status per page group. A change log dated to the day. ## What you keep. Everything above, in plain files. The console access stays yours; I am a user on it, not the owner. No tool login is needed to read the record. If a later developer asks why a redirect exists, the answer is in the log with its date. ## How it is checked. Each finding has a re-test. Index status is confirmed in the engines, not in a crawl log. The rendered page is compared with the source for every template in scope. The engine-only URL list is empty or every entry is explained. The sitemap lists the intended canonical, indexable URLs, and any difference from the observed index is recorded and explained. The crawler policy is live in robots.txt and readable on the page. Every ticket cites its source, so when an AI assistant suggests something different, your developer can see why this change and not that one. ## Who this is for, and who it is not for. For a business that owns its site and can give access to the console, the hosting, and, where they exist, the logs. For a developer or an agency that wants the technical findings as tickets with evidence. For any site about to migrate. Not for a site on a platform that does not allow the changes. Not for a business that wants the audit as a document with no scope behind it; the audit here is the first half of the scope. Not for link buying or for hiding pages from the engines to game a result. ## What sets the price of technical SEO services. - How many URL patterns and templates the site has, not how many pages. - Whether I get console, hosting, CMS, and log access, or work through your developer. - How much is repair (a broken redirect map) and how much is build (a crawler policy, IndexNow, schema that did not exist). - A migration: the size of the URL inventory and the launch date. - How quickly your side approves and applies changes. - One-time or monthly, and for monthly, which checks run every month. The scope states the number after the brief and a look at the site. ## One-time scope or monthly. One-time: the audit, the fixes or the tickets, the migration if there is one, the checks, the handoff. Monthly: a standing crawl-versus-log comparison, index status by page group, the crawler-rule check, the sitemap and IndexNow check, fixes for what the month finds, and a change log. Monthly is scoped per situation on a call after the brief. All four solutions are bought the same way; the [hub](/seo) says how. ## Why one consultant and not a technical SEO agency. Here the person who reads your logs is the person who writes your scope and answers for the result. AI agents do the volume, in parallel, under my review. You can read the [method](/how-it-works) before you pay, and the [free check](/check) shows one piece of it on your own site right now. ## Questions before you send a brief. Do you need my logs? No, but the comparison between what my crawler finds and what the engines fetch needs them. Without logs, the scope says which checks are reduced. Will you work inside my CMS? With access, yes. Without it, every change is a ticket your developer applies. Does a technical fix bring traffic back? It removes the technical barriers the audit found. The engines decide whether and when a page is indexed, and I record index status before and after. Whether the pages rank depends on what they say, which is [on-page and content SEO](/seo/on-page-and-content-seo). ## Read more. - [Technical SEO audit checklist](/articles/technical-seo-audit) - [Site migration SEO guide](/articles/#cluster-seo-by-role) - [robots.txt and crawl budget](/articles/#cluster-seo-by-role) - [How Googlebot renders JavaScript](/articles/#cluster-seo-by-role) - [XML sitemap practices](/articles/xml-sitemap-best-practices-developers) - [Log file analysis for SEO](/articles/#cluster-seo-by-role) ## Send your brief. [Send your brief](/work#send-your-brief) ---- ```text .|########||. .|########||. .|########||. |##||. .||##|. |##||. .||##|. |##||. .||##|. |#|. .|#|. |#|. .|#|. |#|. .|#|. |#| |#| |#| |#| |#| |#| .#| |#. .#| |#. .#| |#. .#. .#| .#. .#| .#. .#| |#. .#| |#. .#| |#. .#| |# ...... #| |# ...... #| |# ...... #| .# ||#########| #| .# ||#########| #| .# ||#########| #| .#. |######||######|. .#. .#. |######||######|. .#. .#. |######||######|. .#. #. .##|###|##|#|######| .# #. .##|###|##|#|######| .# #. .##|###|##|#|######| .# || |##|#||||||||||||#||#| || || |##|#||||||||||||#||#| || || |##|#||||||||||||#||#| || # |#||||||||||||||||||||#| #. # |#||||||||||||||||||||#| #. # |#||||||||||||||||||||#| #. || |#||||||||||||||||||||||#| || || |#||||||||||||||||||||||#| || || |#||||||||||||||||||||||#| || # .#||||||||||||||||||||||||#| # # .#||||||||||||||||||||||||#| # # .#||||||||||||||||||||||||#| # || ....|||#||||||##|#|||#|#||##||||....|. || || ....|||#||||||##|#|||#|#||##||||....|. || || ....|||#||||||##|#|||#|#||##||||....|. || #. . ....|# ....#||| ||| .#||| ....#. .# #. . ....|# ....#||| ||| .#||| ....#. .# #. . ....|# ....#||| ||| .#||| ....#. .# # . ||||#| .#####|| . .#| .#||| ||||# #. # . ||||#| .#####|| . .#| .#||| ||||# #. # . ||||#| .#####|| . .#| .#||| ||||# #. .| ||||| #. |#|||||. || #. |#||. .||||| || .| ||||| #. |#|||||. || #. |#||. .||||| || .| ||||| #. |#|||||. || #. |#||. .||||| || || |.... #. ....|#. |. ...|. ....|| || || |.... #. ....|#. |. ...|. ....|| || || |.... #. ....|#. |. ...|. ....|| || #. .||||||##||||||##||####|||||||#||||||#| .# #. .||||||##||||||##||####|||||||#||||||#| .# #. .||||||##||||||##||####|||||||#||||||#| .# # .||####|###########################|. # # .||####|###########################|. # # .||####|###########################|. # # .#||||||.#.|| # |. ..# #| #|||||#| # # .#||||||.#.|| # |. ..# #| #|||||#| # # .#||||||.#.|| # |. ..# #| #|||||#| # # .#|||||| .. |# ## |#| ...#|#|||#| # # .#|||||| .. |# ## |#| ...#|#|||#| # # .#|||||| .. |# ## |#| ...#|#|||#| # # .#|||#|# .# .#| #| ##|.#..#|||||#| # # .#|||#|# .# .#| #| ##|.#..#|||||#| # # .#|||#|# .# .#| #| ##|.#..#|||||#| # # .#||||||############|######|||||#| # # .#||||||############|######|||||#| # # .#||||||############|######|||||#| # # |...||#||||||#||||#|#||||||#|||||#||| |.| # # |...||#||||||#||||#|#||||||#|||||#||| |.| # # |...||#||||||#||||#|#||||||#|||||#||| |.| # #. .. ||||# .|||##|. |#| .|| || .|||#. #| # .# #. .. ||||# .|||##|. |#| .|| || .|||#. #| # .# #. .. ||||# .|||##|. |#| .|| || .|||#. #| # .# || | ...|| ...##| | #| .|. |. ##### .. .| || || | ...|| ...##| | #| .|. |. ##### .. .| || || | ...|| ...##| | #| .|. |. ##### .. .| || || ||||| || ||||#| . |. |. |#. ||||| |#| || || || ||||| || ||||#| . |. |. |#. ||||| |#| || || || ||||| || ||||#| . |. |. |#. ||||| |#| || || .# |.....#|....|#.||||.|||##.|#|....||.#||.#. #. .# |.....#|....|#.||||.|||##.|#|....||.#||.#. #. .# |.....#|....|#.||||.|||##.|#|....||.#||.#. #. #.|||||||#############################| ||| .# #.|||||||#############################| ||| .# #.|||||||#############################| ||| .# || ##||#||#||||||#||#||#||#||##. || || ##||#||#||||||#||#||#||#||##. || || ##||#||#||||||#||#||#||#||##. || # .#|||||||||#||#|||||||||||#| # # .#|||||||||#||#|||||||||||#| # # .#|||||||||#||#|||||||||||#| # || |#||||||||||||||||||||||#| || || |#||||||||||||||||||||||#| || || |#||||||||||||||||||||||#| || .# |#||||||||||||||||||||#| #. .# |#||||||||||||||||||||#| #. .# |#||||||||||||||||||||#| #. || |#||||||||||||||||||#| || || |#||||||||||||||||||#| || || |#||||||||||||||||||#| || #. .######|#|#########| .# #. .######|#|#########| .# #. .######|#|#########| .# .#. |#####||||#####| .#. .#. |#####||||#####| .#. .#. |#####||||#####| .#. |# ||########|| #. |# ||########|| #. |# ||########|| #. |# ...... #| |# ...... #| |# ...... #| |#. .#| |#. .#| |#. .#| |#. .#. |#. .#. |#. .#. .#| |#. .#| |#. .#| |#. |#| |#| |#| |#| |#| |#| .|#|. .|#|. .|#|. .|#|. .|#|. .|#|. |##||. .||##| |##||. .||##| |##||. .||##| .||########||. .||########||. .||########||. Scale With Search 2026 [scalewithsearch.com](https://scalewithsearch.com) ```