Robots.txt issue

Hello,

I have some issues when trying to implement some robots.txt (so that some pages will not be indexed).

I have generated the auto sitemap, and various robot txt formulas, but nothing works so far.

Here is the screenshot

Have a good evening

Hey Vincent, you really don’t want to do that.
Have a read here-

Instead use this;

Hello! Thank you for your answer :slight_smile:

If i understood well the point, It’s better if I don’t disallow anything on the website (small difference in results, with high chances of doing something wrong).

I ended up writing this :

User-Agent: *
Disallow:

Is it good ?

Have a good day

Correct, and your robots.txt is correctly set to “Allow all” as well.
In general, the easiest solution is to simply not have a robots.txt at all.

1 Like