Per-bot, not one switch
AI crawlers have different jobs. Search bots (OAI-SearchBot, PerplexityBot) fetch to answer live queries; training bots (GPTBot, Google-Extended) collect data. We show each separately.
Free tool · no signup
AI Bot Access Checker
Enter a URL and we read its robots.txt to show exactly which AI crawlers you allow or block — and what each one is actually for.
What this tool checks
Crawl ≠ index
robots.txt controls crawling, not whether you appear. Blocking a bot stops it reading you; it does not remove you from anywhere you already are.
This tool sees your page from the outside
The free Aetos plugin sees inside your WordPress.
This tool checks what a bot sees from a public URL. The free Aetos edition runs a real audit from inside WordPress — across your pages and WordPress environment — so it catches signals an outside view cannot see.
Free edition, no card. Pro adds additional analysis modules, exports, and the AI fix assistant. Want us to do it for you? Talk to the team → Talk to the team
FAQ
Common questions
Should I block AI bots? +
It depends on your goal. Want to be cited in ChatGPT/Perplexity answers? Allow the search bots. Worried about training use? You can block training bots while keeping search bots. We label each so you choose deliberately.
You fetched my robots.txt — is that stored? +
We fetch it once server-side and cache it briefly to avoid hammering your server. We don't keep your URL or build a profile.
It says a bot is allowed but it doesn't cite me. Why? +
Access is necessary, not sufficient. After access come structure, clarity, and authority signals — that's what the rest of these tools (and the plugin) address.