Robots.txt Generator

Part of SEO Tools

Create structured robots.txt files to manage search bot crawlers and specify folder exclusion rules.

Sitemap URL Address

Admin / Sensitive Disallow paths (one per line)

Select your default User-agent permissions (Allow all bots is default).
Specify your Sitemap URL to point crawlers to the map index.
Add custom 'Disallow' paths for sensitive administrative panels or user private folders.
Create, copy, and save your robots.txt to your server's root directory.