Analyze how well your website blocks AI crawlers from scraping your content.
Analyzed 18 known AI crawlers
Note: robots.txt is a voluntary standard. While major AI companies claim to respect it, there's no technical enforcement. Consider this one layer of a broader content protection strategy.
We'll check robots.txt, HTTP headers, and Terms of Service for AI crawler protections.
Keep in mind that this tool is grading you on how comprehensive your blocks are. Higher grades indicate better blocking of AI tools, lower grades indicate AI tools can scrape your site. The grade you want to acheive will depend on your unique strategy as it relates to AI tools.