Robot.txt problem

Problem is Google representative cannot see the robot.txt file, neither I am.

I added it in here:

I’ve tested in here and, get an error:

Why is this happening? I can see the robots.txt when I click

Do you have any idea @vincent?

I would be happy if you can help me :slight_smile:

Hi! I’m not an expert but:

  1. your code is missing a “/”, it should be:

    User-Agent: *
    Disallow: /

  2. the error you’re linking to says it can’t browse the pages, which is normal if you “Disallow” access to robots…

But if i add slash, it probably disallow any robots, see here: Robots.txt File [2020 Examples] - Moz

You’re right, your code isn’t improper.


But if you want to allow all robots everywhere, you don’t need a robots.txt file at all, do you?

1 Like

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.