Free SEO Tool
Robots.txt Analyzer
Validate your robots.txt and see which bots are allowed or blocked.
Analyze Robots.txt
Enter a URL to fetch robots.txt or paste your content directly
What This Tool Analyzes
Search Engine Bots
Check access for Googlebot, Bingbot, DuckDuckBot, and more
Social Media Crawlers
Facebook, Twitter, LinkedIn, Pinterest crawlers
AI Crawlers
GPTBot, ClaudeBot, Google-Extended for AI training
SEO Tool Bots
Ahrefs, SEMrush, Moz, Majestic crawlers
Syntax Validation
Detect errors and get recommendations for fixes
Sitemap Detection
Identify declared sitemaps in your robots.txt