🤖 Robots.txt Generator
Required
Specify the bot you want to target. Use * for all bots.
Recommended
Specify the location of your sitemap.
Set a delay between requests. Recommended: 10 seconds for busy sites.
Optional
Prevent bots from accessing specific directories (comma-separated).
Specify paths bots are allowed to crawl (comma-separated).
Prevent search engines from indexing specific pages (comma-separated).
Specify the preferred domain for your site.