Robots.txt Generator — free online tool
Search engines look for a small file called robots.txt to know which pages they can visit. Writing it by hand is fiddly, and one wrong line can hide your whole site or let bots crawl pages you wanted private. We added a free tool that does it for you — Robots.txt Generator — right in your browser.
What it does
You build a valid robots.txt without remembering the exact wording. Start from a ready preset, or set your own rules for each bot — say what to allow and what to block. The file comes out clean and correctly formatted, ready to drop on your site.
Nothing leaves your device
The whole thing runs in your browser. Your rules and the file you make are never uploaded and never saved on a server. Close the tab and nothing stays behind.
How to use it
- Open Robots.txt Generator and pick a preset, or start from scratch.
- Add your rules — choose which bots to allow or block, per bot.
- Copy the result or download the robots.txt and put it in your site's root.
It's free with no limit. There are more small tools on the Apps page.