I’m publishing a wedding website that I’d like to remain off of search engines, for obvious reasons. I’ve checked “Disable Webflow subdomain indexing” and added the appropriate robots.txt file, but according to other posts in this forum, that only disables indexing of the thissite.webflow.io site, not the custom domain.
How can I disable indexing for the custom domain as well?
Once you’ve published the site you can create a custom robots.txt file to exclude bots.
You can also visit the static page settings for each static page, and configure it to exclude from the sitemap. This will also add a META noindex tag which is great.
CMS pages don’t have that feature, so if you’re using the CMS you can add that META manually, or lean on the robots exclusion approach if you’ve done it before search engines discover you.
Oh interesting! Well then it sounds like I’m all set.
The only other thread on this forum about this exact topic, the OP was told that the custom robots.txt only applied to the webflow.io not the custom domain. I suppose they were just wrong.