robots.txt Validator
Private by design — runs entirely in your browser
Paste your robots.txt and the tool flags syntax errors, orphan directives, unknown rules and non-standard fields with line numbers.
Which rules does the tool check
User-agent grouping, Disallow/Allow placement, Sitemap URL validity, Crawl-delay (warned as non-standard), and unknown directives. Each problem shows the line number for fast fixing.
Will it tell me whether a specific URL is blocked
Not yet — the current check is structural only. Pair it with Google Search Console’s robots.txt tester for path-level enforcement.
Why does Crawl-delay come up as a warning
Googlebot ignores Crawl-delay; Bing and Yandex obey it. We surface the warning so you know not to rely on it for Google but you can keep it for the others.
Frequently Asked Questions
- Which rules does the tool check?
- User-agent grouping, Disallow/Allow placement, Sitemap URL validity, Crawl-delay (warned as non-standard), and unknown directives. Each problem shows the line number for fast fixing.
- Will it tell me whether a specific URL is blocked?
- Not yet — the current check is structural only. Pair it with Google Search Console’s robots.txt tester for path-level enforcement.
- Why does Crawl-delay come up as a warning?
- Googlebot ignores Crawl-delay; Bing and Yandex obey it. We surface the warning so you know not to rely on it for Google but you can keep it for the others.
- Is anything uploaded?
- No. The robots.txt content stays in this tab — no logging, no analytics on the input.