BaseToolbox
Search tools & blog...
⌘K
Blog
Current theme: System (Light)
English
Home
/
robots.txt Generator
robots.txt Generator
Create a robots.txt file for your website. Control how search engine crawlers access your site with an easy visual editor.
Quick Presets:
Allow All
Block All
Standard
User-Agent:
Allow
Disallow
Disallow
Disallow
Add Rule
Add User-Agent Group
Sitemap URL
Crawl Delay (seconds)
Reset
Generated robots.txt
Copy
Download