Welcome to WebmasterWorld Guest from 54.196.244.186

Forum Moderators: open

Message Too Old, No Replies

Googlebot causing 404

     

trayde

2:04 am on Sep 30, 2004 (gmt 0)

Inactive Member
Account Expired

 
 


For the past year Googlebot has been visiting my site and causing 404s. It seems to access:
1) every page = good bot
2) every page + domain name = bad bot
3) every page + domain name minus "www" = bad bot

As far as I can see I don't have any links on any page which links to my domain name without an http:// first. I have contacted google, who insist they are bad links to my site. However, I can only see Googlebots accessing these non existent pages.

Any help would be appreciated.

Thanks.
Jon

3:58 am on Oct 1, 2004 (gmt 0)

Junior Member

10+ Year Member

joined:Nov 21, 2003
posts:48
votes: 0


Have you tried the link: command in Google on the 404's? You might find out who is linking to these bad pages. Alternately, update your robots.txt file to disallow spidering them.