100 % free, for search engines and AI bots
robots.txt & Sitemap Generator
Help Google and the AI engines crawl your site properly. Your robots.txt and sitemap.xml files are built automatically.
1/3
Which site would you like to analyse?
Enter your website address and we will build your robots.txt and sitemap.xml files.
Free and confidential. Nothing is changed on your site.
What you get
The two files every website needs to be found.
🤖
Optimised robots.txt
Rules tuned for search engines and crawlers.
🗺️
sitemap.xml
An XML sitemap built automatically with all your pages.
🧠
AI bot rules
GPTBot, ClaudeBot, PerplexityBot and Google-Extended included.
🔍
Automatic detection
Every page on your site found for you.
💰
100 % free
No cost, no sign-up needed.
📥
Ready to download
Files ready to deploy, sent by email.
How does it work?
1
Enter your URL
Give us your website address.
2
We find your pages
Your site structure is reviewed automatically.
3
Get your files
robots.txt and sitemap.xml sent by email.
★★★★★4.5/5 from 14 reviews
150+ clients supported
Rueil-Malmaison (92)
Google certified