Robots.txt Tester

Paste your robots.txt content, enter a URL path and user-agent, and see instantly whether the path is Allowed or Blocked — with the exact rule that matched.

robots.txt content

URL path to test

User-agent

Runs entirely in your browser. Nothing is uploaded.

How it works

STEP 1

Paste your robots.txt

Copy the contents of your robots.txt file and paste it into the text area.

STEP 2

Enter path & user-agent

Type the URL path you want to test (e.g. /blog/post) and the crawlerʼs user-agent (e.g. Googlebot).

STEP 3

See the result

Click Test — get an instant Allowed or Blocked verdict with the specific rule that matched.