AI Crawler Audit
Which AI bots your robots.txt lets in, and what each block costs you.
Run it →// FREE TOOLS
Eight tools that show your site the way an answer engine reads it. No login. Answers in seconds.
See the questions your buyers ask in ChatGPT, Perplexity and Gemini, and the answers they get back. Find where a competitor shows up instead of you, and where the answer about you is simply wrong.
Get the Diagnostic →
Scores are benchmarked against 101 sites we measured: median 61, best 80. Read the research →
// CAN AI READ YOUR SITE?
Technical readiness. All three run instantly, free.
// IS YOUR CONTENT QUOTABLE?
Page level fixes. Both run instantly, free.
// ARE YOU SHOWING UP?
Measure your visibility in AI answers. These three query ChatGPT, Perplexity and Gemini live, three of the six engines we track, which costs us per run, so they open on request.
Ask the engines your customers’ questions. See who gets cited instead of you.
Which domains AI cites for your topics, and where you rank among them.
// AI visibility tool
The tools above check your site once. Answer Monitor keeps checking, and each month shows you what changed: whether the engines still name you, still cite you, and still get your facts right.
// Not a free tool · Built for you inside the Diagnostic
We crawl every page on your site and draw the map of how they link to each other, then lay your AI citations over the top. It answers one question: is your site sending its authority to the pages AI quotes? Usually not. The pages that earn citations are often buried three clicks deep, while the homepage links point somewhere else entirely. There is no button to press here. We build one by hand for every company we audit, and it arrives as an interactive map you can click through.
Whether AI can find, read, understand, and cite your site, across nine dimensions: from crawler access to how cleanly an answer can be lifted from your page. One scan rolls them into a single score.
Your site gets a source link but your brand never gets named in the answer. Kevin Indig's research with Semrush found 61.7% of AI citations work this way. The Ghost Citation Check shows where it's happening to you.
Allow the crawlers that fetch pages for live answers: OAI-SearchBot and ChatGPT-User for ChatGPT, PerplexityBot and Perplexity-User for Perplexity, and Claude-User for Claude. Blocking them removes you from those answers before anything else matters. GPTBot, ClaudeBot and Google-Extended collect training data, so blocking them is a licensing choice. Google-Extended does not control AI Overviews. Those follow your normal Google Search snippet settings. The Crawler Audit checks all of them in one run.
Run the Citation Gap tool with a question your buyers ask. It shows which engines cite you, which cite someone else, and which sources they pull from instead.
Analytics cookies
We use Google Analytics to see which pages get read. It sets a cookie and gives your browser an ID. Nothing loads unless you say yes, and the site works either way. What we collect.