Prevent Google Indexing files in uploads areas

I have a client who wishes their images not to appear on search engines.

So far I added this to the robots.txt…

===START
User-agent: Googlebot-Image
Disallow: /

User-agent: *
Disallow: /.gif$
Disallow: /
.jpg$
Disallow: /.jpeg$
Disallow: /
.png$
====END

Is that the correct syntax? Not sure where I got this from.

It didn’t work - images were still creeping into search results, so I’m now trying to ban all search indexing (this is not a site that relies on search discovery)

I’ve replaced “Googlebot-Image” with “*”

I’ve also added…


…to the HEAD for all pages on the site.

Anything else I can do to keep the bots at bay?


Here is my site Read-Only: LINK
(how to share your site Read-Only link)

Image are not hosted on your domain, but on webflow cdn, the robots.txt will prevent seeing your domain only

2 Likes

Then you would need to move the site to your own external hosting. You can’t control CDN indexing as @pietrofalco indicated.

1 Like