Robots.txt Tester — free online tool
You changed your robots.txt and now you're not sure: will Google actually be allowed to crawl that page, or did you block it by mistake? Reading those rules by eye is easy to get wrong, and one stray line can hide a whole section of your site. We added a free tool that checks it for you — Robots.txt Tester — right in your browser.
What it does
Paste your robots.txt content, type in a URL path and pick a user-agent (like Googlebot), and it tells you straight away whether that path is Allowed or Blocked. It also shows you the exact rule that made the decision, so you know which line is doing the work and can fix it if it's wrong.
Nothing leaves your device
The whole check runs inside your browser. Your robots.txt and the paths you test are never uploaded and never saved anywhere. When you close the tab, nothing is left behind.
How to use it
- Open Robots.txt Tester and paste your robots.txt content into the box.
- Enter the URL path you want to test and choose a user-agent.
- Read the Allowed or Blocked result and the exact rule that caused it.
It's free with no limit. There are more small tools on the Apps page.