Prevent Google Indexing files in uploads areas

I have a client who wishes their images not to appear on search engines.

So far I added this to the robots.txt…

User-agent: Googlebot-Image
Disallow: /

User-agent: *
Disallow: /.gif$
Disallow: /
Disallow: /.jpeg$
Disallow: /

Is that the correct syntax? Not sure where I got this from.

It didn’t work - images were still creeping into search results, so I’m now trying to ban all search indexing (this is not a site that relies on search discovery)

I’ve replaced “Googlebot-Image” with “*”

I’ve also added… the HEAD for all pages on the site.

Anything else I can do to keep the bots at bay?

Here is my site Read-Only: LINK
(how to share your site Read-Only link)

Image are not hosted on your domain, but on webflow cdn, the robots.txt will prevent seeing your domain only


Then you would need to move the site to your own external hosting. You can’t control CDN indexing as @pietrofalco indicated.

1 Like