Robots.txt Generator

Create and validate custom robots.txt files to manage search engine crawler permissions and directive rules.

Robots.txt Settings

User Agent

Crawl Delay

Sitemap URL

Disallow Rules

Generated robots.txt

# robots.txt generated by Aidelico Tools User-agent: * Allow: /public/ Allow: /media/ Disallow: /admin/ Disallow: /private/ Disallow: /api/ # Sitemap Location Sitemap: https://example.com/sitemap.xml