Forum Moderators: open

Message Too Old, No Replies

Googlebot causing 404

         

trayde

2:04 am on Sep 30, 2004 (gmt 0)



For the past year Googlebot has been visiting my site and causing 404s. It seems to access:
1) every page = good bot
2) every page + domain name = bad bot
3) every page + domain name minus "www" = bad bot

As far as I can see I don't have any links on any page which links to my domain name without an http:// first. I have contacted google, who insist they are bad links to my site. However, I can only see Googlebots accessing these non existent pages.

Any help would be appreciated.

Thanks.
Jon

celenoid

3:58 am on Oct 1, 2004 (gmt 0)

10+ Year Member



Have you tried the link: command in Google on the 404's? You might find out who is linking to these bad pages. Alternately, update your robots.txt file to disallow spidering them.