Hey anybody able to help me with this? I’m trying to setup robots.txt, but I’m not sure if I’ve done it correctly… I don’t want the following pages to be ignored:
- https://dockfec.webflow.io/cookies-consent/
- https://dockfec.webflow.io/test-pagina/
- https://dockfec.webflow.io/pop-ups/pop-up-page/ (all CMS pages)
- https://dockfec.webflow.io/socials-feed/socials-feed-page/ (all CMS pages)
- https://dockfec.webflow.io/reviews/review-page/ (all CMS pages)
- https://dockfec.webflow.io/ticket-filters/ticket-filter-page/ (all CMS pages)
- Beveiligde Pagina | DOCK Family Entertainment Center
- Pagina Niet Gevonden | DOCK Family Entertainment Center
- Zoekresultaten | DOCK Family Entertainment Center
User-agent: *
Disallow: /cookies-consent/
Disallow: /test-pagina/
Disallow: /pop-ups/pop-up-page/
Disallow: /socials-feed/socials-feed-page/
Disallow: /reviews/review-page/
Disallow: /ticket-filters/ticket-filter-page/
Disallow: /401/
Disallow: /404/
Disallow: /search/
Thanks in advance!