Robots.txt Generator Tool

Robots.txt Generator

User-agent:Allow (one per line):Disallow (one per line):Crawl-delay (optional):Sitemaps (one per line):Generate

Preview robots.txt