homepage Welcome to WebmasterWorld Guest from 23.22.217.122
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

    
Googlebot Revisiting Constantly
Home page and /robots.txt every 7-10 seconds.
JKMitchell




msg:706067
 10:10 am on Feb 22, 2005 (gmt 0)

Hi there,

My first post!

I have a client site that for the past three days has been constantly visited by a Googlebot on 66.249.65.239 When I say constantly I mean once every 7 - 10 seconds this bot checks the robots.txt and home page and that's all.

The site works for other bots including googlebots on other IP addresses. I assume from this that the robots.txt and .htaccess are correct (or else I'd expect other googlebots to complain as well).

Has anyone else found a problem with the bot on this particular IP address?

Cheers

John

 

theBear




msg:706068
 1:20 pm on Feb 22, 2005 (gmt 0)

It is in love with your home page ;).

Make sure you've explained the facts of life to your web site as the offspring could wreck havoc on the web.

Make sure you aren't running any cloaking scripts.

JKMitchell




msg:706069
 4:34 pm on Feb 22, 2005 (gmt 0)

There are no scripts of any kind on the page, the .htaccess is only to redirect 404 errors and the robots.txt is empty (but exists to save 404 errors in the log).

The confusing thing is that it's only this IP address that is looping round the home page, other googlebots from different IP's (and other engines) are working fine.

As an aside, the "Son of Google", how frightening is that?

Cheers

John

theBear




msg:706070
 7:32 pm on Feb 22, 2005 (gmt 0)

I'd be worried about "BOT302 the Redirector from Hell" not "Son of Googlebot" it's the mutations that'll get ya.

Report the bot to Google, maybe G can fix it.

trillianjedi




msg:706071
 7:36 pm on Feb 22, 2005 (gmt 0)

Are you serving it a Session ID?

TJ

JKMitchell




msg:706072
 9:42 am on Feb 23, 2005 (gmt 0)

Nope, it's a standard html page with text and an image on the page (company logo) but that's all.

Cheers

John

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved