16 AI crawlers tracked by name
Corvane Legal: AI content engine
A German law firm’s knowledge engine with 1,100+ pages live on its own domain, per-bot crawler analytics and an alert if AI crawlers stop coming.
- Content engine
- Crawler analytics
Found · The paid starting point
In seven business days you’ll know why ChatGPT, Perplexity, Gemini, Claude and Google’s AI Overviews name your competitors instead of you, and exactly what it costs to fix, in fixed quotes.
Fixed price. 100% credited to any build within 60 days.
Proof on file
My own previous site0
words of page content visible to non-JavaScript crawlers
The first site I audited this way was my own. It looked finished in every browser. Crawlers received an empty shell. This site is the rebuild.
observed 2026-10-05 · raw HTML fetch
03 Fit
Built for you if
Not for you if
04 The problem
A buyer asks an assistant for the best firms for their problem. It answers in seconds, with names. If yours isn’t one of them, you never find out: no visit, no bounce, nothing in your analytics. G2 found that 51% of B2B software buyers start research in an AI chatbot, and 6sense reports that 85–95% of B2B buyers buy from their day-one shortlist.
The causes are usually ordinary and fixable: a CDN rule that quietly blocks GPTBot, pages that show nothing without JavaScript, a company description that differs on every profile, service pages that never answer a question directly. The trouble is that all of them are invisible from the inside. In your own browser, the site looks fine.
The audit looks from the outside, the way an assistant does, and puts a date and a method next to every finding.
Signs you need this
06 What you get
One domain, one language, your main competitors. Everything is dated and reproducible, so you can re-run it yourself next quarter.
GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot, Google-Extended and more, tested against robots.txt, Cloudflare bot rules and firewall traps that block them silently.
What a crawler actually receives from your key pages: words, headings, links and structured data, page by page.
Real questions your buyers ask, run on ChatGPT, Perplexity, Gemini, Claude and Google AI Overviews. Who is named, who is cited, and from which sources.
How often you and the competitors you choose appear, and which pages and profiles assistants cite for them.
Is your company described the same way everywhere? Organization, Service and Person markup, sameAs links, directory and review profiles.
What happens when an assistant does send someone: landing page, speed, proof, prices, form, reply time, and where they drop.
I walk you through the findings on a call, recorded so partners who weren’t there can watch it later.
Every fix ranked by effort and impact, with a fixed price for anything I would do. Do it yourself, with your agency, or with me.
07 How it runs
Agents run the repetitive tests at scale. I design the prompts, read every result and write every conclusion. Nothing reaches you that I can’t reproduce.
Agents at work Human gate: nothing moves on until a person approves
Step 1: Day 1
A 20-minute call. You name your competitors and the questions buyers ask before they call you. I turn them into 30 test prompts.
Human gate You approve the prompt set and the competitor list.
Step 2: Days 1–3
Crawler access, no-JavaScript render, schema extraction and speed checks across your key pages.
Step 3: Days 2–4
Every prompt run on five assistants, with answers and citations captured and dated so they can be compared later.
Step 4: Days 4–5
Findings cross-checked against the raw captures. Anything that can’t be reproduced is dropped, not reported.
Human gate I review every finding before it reaches you.
Step 5: Days 6–7
The recorded walkthrough, the written report and the 90-day plan with fixed quotes.
Human gate You decide what happens next. There is no obligation.
08 Proof
The law-firm engine counts AI crawlers by name every day and raises an alert when they stop visiting. The audit uses the same thinking on your site, once, in depth.
16 AI crawlers tracked by name
A German law firm’s knowledge engine with 1,100+ pages live on its own domain, per-bot crawler analytics and an alert if AI crawlers stop coming.
15 would-be 404s caught
A hop-by-hop audit of every sitemap URL, internal link and archived address, run before the new site went anywhere near live.
Want to see the format first? Run the free audit on your own site, then ask me for the sample Deep Audit on a call.
09 Price
The audit is a fixed €1,500 · $1,650. 100% credited to any build within 60 days. Scope only changes if you ask for more, and then it’s quoted before work starts.
Quoted separately
Always included
Paid by you, directly to each provider, in your own accounts. I add no markup and no hosting fee.
| What | How it works | Paid to |
|---|---|---|
| During the audit | Nothing. I use my own tools and accounts; you only grant read-only access if you want firewall rules checked. | Nobody |
| After the audit | Each fix in the 90-day plan states its own running cost, if it has one. Most have none. | Stated per fix |
100% credited to any build within 60 days. If you build elsewhere, the plan and quotes are yours to take with you.
10 Handover
No licence fees to me, no lock-in, no proprietary platform. Everything is dated and reproducible: rerun the prompt set yourself or hand the report to any agency.
11 Questions

Not sure the audit is the right first step?
20 minutes with me, not a sales rep. You leave with a clear next step — whether or not we work together.
Text extracted from the HTML this server sends — no JavaScript executed, the way GPTBot, ClaudeBot and PerplexityBot fetch pages. It is also the Markdown twin I publish for AI agents.
Loading…
<!doctype html> <title>Custom Web Tools & Cookie-Free Websites | AIWebRevolution</title> … <body> <div id="root"></div> <script type="module" src="/assets/index.js"></script> </body> → 0 words of page content. Beautiful to people. Blank to ChatGPT.
Two minutes · personal reply