Based on another Webflow post…I started researching 404 Disallow of the 404 page vs NoIndex in meta data.
After a few hours, I came across sources that said disallow the 404 page isn’t a guarantee it won’t be indexed but that disallowing the 404 page could possible cause crawl issues for the entire site.
Adding meta name=“robots” content=“noindex” and meta name=“googlebot” content=“noindex” should accomplish no indexing. Since we can now add header data to each page would this method be safer/better than disallow? Adding that meta data to the 404 page shows towards the bottom of the header code when added in Webflow.
@mbrannon47 Before using Webflow I was using “noindex” in the meta. Initially, Webflow didn’t have per-page meta available if hosting with Webflow. I feel better using “noindex” over “disallow” (and I hate seeing the errors in webmaster tools)…so I’ll be switching back to the “noindex” method.