Welcome to WebmasterWorld Guest from 220.127.116.11 , register , free tools , login , search , subscribe , help , library , announcements , recent posts , open posts Subscribe and Support WebmasterWorld
Googlebot Revisiting Constantly Home page and /robots.txt every 7-10 seconds. JKMitchell msg:706067 10:10 am on Feb 22, 2005 (gmt 0) Hi there,
My first post!
I have a client site that for the past three days has been constantly visited by a Googlebot on 18.104.22.168 When I say constantly I mean once every 7 - 10 seconds this bot checks the robots.txt and home page and that's all.
The site works for other bots including googlebots on other IP addresses. I assume from this that the robots.txt and .htaccess are correct (or else I'd expect other googlebots to complain as well).
Has anyone else found a problem with the bot on this particular IP address?
theBear msg:706068 1:20 pm on Feb 22, 2005 (gmt 0)
It is in love with your home page ;).
Make sure you've explained the facts of life to your web site as the offspring could wreck havoc on the web.
Make sure you aren't running any cloaking scripts.
JKMitchell msg:706069 4:34 pm on Feb 22, 2005 (gmt 0)
There are no scripts of any kind on the page, the .htaccess is only to redirect 404 errors and the robots.txt is empty (but exists to save 404 errors in the log).
The confusing thing is that it's only this IP address that is looping round the home page, other googlebots from different IP's (and other engines) are working fine.
As an aside, the "Son of Google", how frightening is that?
theBear msg:706070 7:32 pm on Feb 22, 2005 (gmt 0)
I'd be worried about "BOT302 the Redirector from Hell" not "Son of Googlebot" it's the mutations that'll get ya.
Report the bot to Google, maybe G can fix it.
trillianjedi msg:706071 7:36 pm on Feb 22, 2005 (gmt 0)
Are you serving it a Session ID?
JKMitchell msg:706072 9:42 am on Feb 23, 2005 (gmt 0)
Nope, it's a standard html page with text and an image on the page (company logo) but that's all.