Free tool · Fetches your public page
Enter a domain; helloAISearch fetches its robots.txt and tests it against 18 AI crawler tokens, from GPTBot and OAI-SearchBot to ClaudeBot, PerplexityBot and Google-Extended. You see which are allowed, which are blocked, and which blocks remove you from answers rather than from training.
Want this checked on every engine, on a schedule? Start the free 3-day trial. No credit card.
One check is a snapshot. A schedule is a measurement.
helloAISearch runs your prompts on ChatGPT, Claude, Gemini and Perplexity on a schedule, highlights every mention, and turns each gap into one move per day.
Questions
OAI-SearchBot and ChatGPT-User feed ChatGPT search and browsing; Claude-SearchBot and Claude-User feed Claude; PerplexityBot and Perplexity-User feed Perplexity; Googlebot feeds Search, AI Overviews and AI Mode; Bingbot feeds Copilot. GPTBot, ClaudeBot, Google-Extended, Applebot-Extended, CCBot and the rest collect training data, and blocking them does not remove you from today's answers.
No. A crawler with no group of its own follows the * group, and with no robots.txt at all everything is allowed. The checker says so explicitly rather than reporting a pass you never configured.
The checker reads robots.txt only. A firewall rule, a bot-management product or a login wall blocks crawlers without leaving any trace in robots.txt. If you use one, check its AI-crawler settings separately; the effect on citations is the same.
It is a policy choice, not a visibility one. Blocking GPTBot or ClaudeBot keeps pages out of future training sets and does not change whether ChatGPT or Claude can cite you today. The generator tool writes that split for you.
Related tools
Read next
Free 3-day trial · No credit card · Cancel anytime
Three minutes from signup to reading what ChatGPT and Gemini say about your brand. Everything the trial finds is saved whether or not you subscribe.
hello, AI search.