Welcome to WebmasterWorld Guest from 54.145.166.247

Forum Moderators: open

Message Too Old, No Replies

Googlebot causing 404

   
2:04 am on Sep 30, 2004 (gmt 0)

10+ Year Member



For the past year Googlebot has been visiting my site and causing 404s. It seems to access:
1) every page = good bot
2) every page + domain name = bad bot
3) every page + domain name minus "www" = bad bot

As far as I can see I don't have any links on any page which links to my domain name without an http:// first. I have contacted google, who insist they are bad links to my site. However, I can only see Googlebots accessing these non existent pages.

Any help would be appreciated.

Thanks.
Jon

3:58 am on Oct 1, 2004 (gmt 0)

10+ Year Member



Have you tried the link: command in Google on the 404's? You might find out who is linking to these bad pages. Alternately, update your robots.txt file to disallow spidering them.