Streaming live at 10am (PST)

Please - Indexing (Sitemap.xml & Robots.txt)

Hey!

So I’m having trouble indexing my site.
When I try the google rich results test or when I try to upload my sitemap on the google search console. I get an error… See below.


I want all pages to be crawled so bots can crawl through my site except for the following pages:

And same for all the cms collection pages from 4 different cms collections:

  • pop-ups
  • socials-feed
  • reviews
  • ticket-filters

This is the sitemap I setup.
User-agent: *
Disallow: /cookies-consent/
Disallow: /test-pagina/
Disallow: /pop-ups//
Disallow: /socials-feed/
/
Disallow: /reviews//
Disallow: /ticket-filters/
/
Disallow: /401/
Disallow: /404/
Disallow: /search/

Please help me, because it’s driving me nuts…

Thanks in advance!

With kind regards,
Tim Sijtema


READ ONLY

Posting your previous posts here for reference.

Also some links to the University links that may help.

@matthewpmunger Anyway you can have a look at this, because to my knowledge I’ve setup everything correctly and I’m kinda getting frustrated… How do I fix this issue…

Thanks in advance.

Hey @TimSijtema, I do not have any experience or knowledge on this subject so hopefully the broader community here has insights.

If not, you can contact our Customer Support Team at support@webflow.com. It is likely we’ll need to investigate and discuss your project settings. One of our Customer Support Team Specialists will be able to investigate and respond via email! Thank you so much!

Bumping this thread, I’ve sent webflow a mail, but I’d really like to move on with the next thing and fix this thing… It’s driving me nuts. So if anybody is willing to help me it would be appreciated.

If you need any info, just reply on this thread.

Thanks in advance!

With kind regards,
Tim Sijtema

It’s been resolved. Forum can be closed.

1 Like