How to Customize robots.txt in Webflow

In this tutorial, Sandro, co-founder of the Gemeos Webflow agency, shows you how to customize your Webflow site’s robots.txt file.

1. Open Webflow’s robots.txt

In Project Settings > SEO, scroll down to the Robots.txt section. Webflow shows the default robots.txt and lets you customize it.

2. Block specific paths

To block robots from accessing certain pages or sections, add Disallow directives. Example: block a confirmation page and the admin folder:

User-agent: *
Disallow: /confirmation
Disallow: /admin/

3. Add your sitemap

Add your sitemap reference at the bottom of robots.txt: Sitemap: https://votre-domaine.fr/sitemap.xml. This helps search engines find it automatically, even without manual submission.

4. Check after publishing

After publishing, check your robots.txt by going to votre-domaine.fr/robots.txt. Also test it in Google Search Console > robots.txt Tester.

Conclusion

Webflow’s robots.txt is customized directly in Project Settings. See also: disable page indexing.