Robots.txt Rule Tester

Paste robots.txt rules, enter a user-agent and URL path, and see which wildcard, Allow or Disallow rule wins.

Decision-
Winning rule-
Groups used-

Use this when a crawl rule looks simple but the matching path is not obvious. The tester applies longest-match logic, supports common wildcard and end-anchor patterns, and shows the exact group and directive that decided the result.

What to paste

Paste the relevant robots.txt text, then test the user-agent and path you care about. For a full URL, the tool uses the path and query portion because robots rules do not compare the domain.

What this does not prove

The result is a local rule check. It does not fetch your live robots.txt, confirm that the page is indexed, or account for search engine-specific behavior outside the pasted rules.