Welcome to WebmasterWorld Guest from 54.221.119.45

Forum Moderators: open

Message Too Old, No Replies

Googlebot causing 404

     

trayde

2:04 am on Sep 30, 2004 (gmt 0)



For the past year Googlebot has been visiting my site and causing 404s. It seems to access:
1) every page = good bot
2) every page + domain name = bad bot
3) every page + domain name minus "www" = bad bot

As far as I can see I don't have any links on any page which links to my domain name without an http:// first. I have contacted google, who insist they are bad links to my site. However, I can only see Googlebots accessing these non existent pages.

Any help would be appreciated.

Thanks.
Jon

celenoid

3:58 am on Oct 1, 2004 (gmt 0)

10+ Year Member



Have you tried the link: command in Google on the 404's? You might find out who is linking to these bad pages. Alternately, update your robots.txt file to disallow spidering them.
 

Featured Threads

Hot Threads This Week

Hot Threads This Month