What is GEO and why does it matter?

GEO stands for Generative Engine Optimization. It is the practice of making your site visible to AI assistants like ChatGPT, Gemini, Claude, and Perplexity. These are where a growing share of people now search for services. If your site is not structured for GEO, you are invisible to that traffic. Most audit tools do not score for this. Canopy Guard does.

Answer Engine Optimization. It is the practice of structuring your content to directly answer questions. Voice search results, Google AI Overviews, and featured snippets all favor sites built for AEO. It overlaps with GEO but focuses on traditional answer engines and search result features rather than generative AI specifically.

Does scanning my site affect its performance or SEO?

No. Canopy Guard reads only publicly available information, the same data any search engine crawler sees. We do not touch your server, database, or code. Running a scan has zero impact on your site performance or rankings.

What does MITRE ATT&CK mean for my website?

MITRE ATT&CK is a globally recognized framework for understanding how attackers operate. For each security finding, Canopy Guard identifies the exposure condition associated with the relevant MITRE ATT&CK technique, so you get context for what the gap actually exposes you to, not just a number. This comes from Adam's CISSP background and 20 years in cybersecurity.

What does Canopy Guard's security scan check for?

Across nine security layers, Canopy Guard checks TLS and certificates, DNS, HTTP headers, HTML vulnerabilities, and exposed paths, plus four expanded capabilities: malware and reputation scanning against Google Safe Browsing and common blacklists (reported as Clean, Flagged, or Blacklisted); an expanded footprint covering Subresource Integrity on scripts and stylesheets, Secure and HttpOnly cookie flags, full TLS cipher-suite enumeration with weak-cipher warnings, and certificate transparency log presence; expanded DNS and email depth that parses SPF mechanisms and qualifiers, reports the DMARC policy as none, quarantine, or reject, and checks registrar lock and days until expiration (flagging domains expiring within 60 days as a hijacking risk); and exposed sensitive file detection for paths like /.env, /.git/config, /wp-config.php.bak, /.aws/credentials, and /admin, reporting any publicly accessible path as Critical. Every check is passive and read-only, and each finding identifies the exposure condition associated with a MITRE ATT&CK technique.

My score is low. What do I do next?

Your full report includes prioritized findings so you know exactly what to fix first. If you want to implement the recommendations yourself, the report gives you enough to work from. If you want it done for you, book a call with Adam. Canopy Guard customers receive a discount on all implementation services.

How is this different from other SEO tools?

Three things. First, GEO scoring is rare at this price point, which is free. Second, the security findings are mapped to MITRE ATT&CK, not flagged generically. Third, there is a real human behind this tool who can implement everything the audit finds. Most tools give you data. This one connects you to someone who fixes it.

Is my site data private?

Yes. Canopy Guard only scans publicly available data, the same information any search engine sees. We do not store your site's private content, login credentials, or analytics. See our Privacy Policy for full details.

Do I need an account to get my full report?

No account required to run the scan. When you download your full report, basic contact information is collected so we can follow up if you have questions. That information is handled securely and never sold or shared with third parties.

How does Canopy Guard compare to hiring an SEO agency?

An agency charges a monthly retainer and often reports only on traditional SEO. Canopy Guard gives you the full picture for free across SEO, AEO, GEO, and security in 30 seconds, with findings mapped to MITRE ATT&CK. When you want the work implemented, you hire Adam directly. No retainer, no account managers, just the practitioner who built the tool.

What does a good overall score look like, and what should I do if mine is low?

Above 80 is strong, 50 to 80 means clear fixable gaps, and below 50 signals problems costing you visibility or trust right now. A low score is not a verdict, it is a roadmap. Your report ranks findings by impact so you fix what matters first, and Canopy Guard customers get a discount if you want it done for you.

How often should I re-scan my site?

Re-scan after any meaningful change: a redesign, new pages, a platform migration, or after applying fixes from a previous report. For an active site, a monthly scan catches regressions before they cost you traffic. Because the scan is free and takes 30 seconds, there is no reason to wait for a problem to show up in your analytics first.

Which search engines and AI assistants does Canopy Guard check for?

Canopy Guard evaluates your readiness for traditional search like Google and Bing, AI answer engines like Google AI Overviews and featured snippets, and generative assistants including ChatGPT, Gemini, Claude, and Perplexity. It inspects your structured data, llms.txt, crawler access, and content structure to estimate how each of those systems can find, parse, and cite your pages.

Blog · 5 min read · 2026-07-17

How robots.txt Is Quietly Blocking the AI Crawlers You Actually Want

By Adam McClarin, CISSP · Meraki is Love (Soulful Tech) · Friendswood, Texas

The assumption that breaks visibility

Blocking bad bots and blocking AI crawlers often use the same rule by accident.

When we found our own crawler activity was lopsided, one engine dominant, two others barely present, the first place we looked was robots.txt. Most teams write that file once, early, usually to keep aggressive scrapers off a staging environment. Nobody revisits it once the site is live.

The problem is that a rule written to block a scraper three years ago can end up blocking GPTBot, ClaudeBot, or Google-Extended today, without anyone noticing, because the site still ranks fine in traditional search. AI visibility fails silently. There is no error page, no broken link. The crawler just does not come back.

Three patterns worth checking today

A wildcard rule, a missing allow, and a crawl budget nobody planned for.

A blanket Disallow rule under User-agent: * catches every crawler unless a specific engine is explicitly allowed underneath it. If the file only has one generic block, check whether it is silently catching the AI engines too.

Some teams add rules for GPTBot without knowing ClaudeBot and Google-Extended are separate user agents entirely. Blocking one does nothing to the other two, and allowing one does not mean the others are welcome.

Crawl budget matters more than people expect. A site with thousands of pages and a thin server response can get deprioritized by a crawler long before robots.txt becomes the issue. Check response times before assuming access is the only variable.

How to check your own site

Three steps, no special tools required.

Pull up yourdomain.com/robots.txt directly in a browser and read every line. Look for User-agent: * blocks and check what falls under them.

Search for GPTBot, ClaudeBot, and Google-Extended by name. If they are not mentioned at all, that usually means they are allowed by default, which is good. If they are listed under a Disallow, that is the fix.

Run the domain through an audit tool that checks crawler access specifically, not just traditional SEO signals. That is the piece most general purpose SEO tools skip entirely.

See where your own site stands across SEO, AEO, GEO, and security in about 30 seconds.

Run your free scan Book a call with Adam

Frequently asked questions

What is the difference between GPTBot, ClaudeBot, and Google-Extended?

These are the separate crawler user agents used by OpenAI, Anthropic, and Google to index content for their AI models. Each one respects robots.txt independently, so a rule written for one does not apply to the others.

Can blocking AI crawlers hurt traditional SEO too?

Not directly. Traditional search crawlers like Googlebot are usually separate from AI training and retrieval crawlers like Google-Extended. But a robots.txt file written broadly enough to catch AI crawlers can sometimes catch more than intended, so it is worth checking both.

How often should robots.txt be reviewed?

Any time a new AI engine gains meaningful market share, or any time a site's visibility across engines looks uneven despite strong content. A quarterly check is a reasonable baseline for an active site.

← All articles Run a free audit →