Welcome to WebmasterWorld Guest from 54.145.136.73

Googlebot Revisiting Constantly

Home page and /robots.txt every 7-10 seconds.

   
10:10 am on Feb 22, 2005 (gmt 0)

10+ Year Member



Hi there,

My first post!

I have a client site that for the past three days has been constantly visited by a Googlebot on 66.249.65.239 When I say constantly I mean once every 7 - 10 seconds this bot checks the robots.txt and home page and that's all.

The site works for other bots including googlebots on other IP addresses. I assume from this that the robots.txt and .htaccess are correct (or else I'd expect other googlebots to complain as well).

Has anyone else found a problem with the bot on this particular IP address?

Cheers

John

1:20 pm on Feb 22, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



It is in love with your home page ;).

Make sure you've explained the facts of life to your web site as the offspring could wreck havoc on the web.

Make sure you aren't running any cloaking scripts.

4:34 pm on Feb 22, 2005 (gmt 0)

10+ Year Member



There are no scripts of any kind on the page, the .htaccess is only to redirect 404 errors and the robots.txt is empty (but exists to save 404 errors in the log).

The confusing thing is that it's only this IP address that is looping round the home page, other googlebots from different IP's (and other engines) are working fine.

As an aside, the "Son of Google", how frightening is that?

Cheers

John

7:32 pm on Feb 22, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I'd be worried about "BOT302 the Redirector from Hell" not "Son of Googlebot" it's the mutations that'll get ya.

Report the bot to Google, maybe G can fix it.

7:36 pm on Feb 22, 2005 (gmt 0)

WebmasterWorld Senior Member trillianjedi is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Are you serving it a Session ID?

TJ

9:42 am on Feb 23, 2005 (gmt 0)

10+ Year Member



Nope, it's a standard html page with text and an image on the page (company logo) but that's all.

Cheers

John

 

Featured Threads

My Threads

Hot Threads This Week

Hot Threads This Month