Robots.txt Generator

Compose a valid robots.txt: choose a policy preset or customize allows/disallows, add crawl-delay and Sitemaps, then copy.

Site URL

Used to build absolute Sitemap URLs if needed.

Preset

User-agent

Use * to target all crawlers.

Disallow paths

Allow paths

Crawl-delay (seconds)

Note: Not supported by Google; used by Bing/Yandex.

Sitemaps

Preview robots.txt

User-agent: *
Disallow: /admin
Disallow: /api
Allow: /

Sitemap: https://www.example.com/sitemap.xml

Place at /robots.txt. Use Sitemaps for discovery of URLs.

Generate and preview SERP‑friendly copy.

Build JSON-LD FAQPage markup.

Build social meta tags with live preview.

For less than your daily coffee, deliver powerful audits that impress clients, boost conversions, and grow your freelance business.

Don't wait; start turning your site audits into profits today!