Hello,
I have some issues when trying to implement some robots.txt (so that some pages will not be indexed).
I have generated the auto sitemap, and various robot txt formulas, but nothing works so far.
Here is the screenshot
Have a good evening
Hello,
I have some issues when trying to implement some robots.txt (so that some pages will not be indexed).
I have generated the auto sitemap, and various robot txt formulas, but nothing works so far.
Here is the screenshot
Have a good evening
Hey Vincent, you really don’t want to do that.
Have a read here-
Instead use this;
Hello! Thank you for your answer
If i understood well the point, It’s better if I don’t disallow anything on the website (small difference in results, with high chances of doing something wrong).
I ended up writing this :
User-Agent: *
Disallow:
Is it good ?
Have a good day
Correct, and your robots.txt is correctly set to “Allow all” as well.
In general, the easiest solution is to simply not have a robots.txt at all.