|
Generate a robots.txt file for your site.
How to Use
- Set your sitemap URL if you have one.
- Add user-agent rules with disallow and allow paths.
- The generated robots.txt updates live. Copy it to your site root.
Generators (47)
css (19)
color (8)
codes & data (7)
content (7)
documents (6)
|