← All free tools
AI search · Free, pasted text analysis
AI crawler checker
Analyze pasted robots.txt rules for AI crawlers, without fetching your website.
Your result
Enter your inputs to begin.
How to read this result
MARqentic analyzes only the text you submit against one path using its shared robots.txt parser: crawler-specific groups take precedence over wildcard groups; the longest matching rule wins and Allow wins ties. The pasted text is sent to MARqentic for analysis. This does not fetch your website, check CDN or WAF blocks, verify HTTP status, or prove that a crawler will visit. Non-ASCII and encoded-path normalization is not simulated. Google-Extended governs AI use separately from Googlebot access.