Welcome to WebmasterWorld Guest from 188.8.131.52
Forum Moderators: goodroi
I set up a new robots.txt file 2 days ago.
I put it under [mashoomashoo.com...]
The file looks like this:
The search engines still look at the disallowed directories. For example Googlebot was in:
What is wrong?
Thanks in advance for the help
now that said googlebot has been prying in places it would not normally go, so it could be a glitch with googlebot at this present time.