Page is a not externally linkable
caspita - 3:04 pm on Mar 24, 2005 (gmt 0)
Well I think it would be nice to get an answer from GG on this. I just posted the following info in the other post .. I'll put it here just to be sure that we have more chance getting a response ;-). =============================== Hi All, Well .. this Googlebot is back in my site, it came by y'day looking for 3-4 pages, noe the UA is comming as: before it was: So.. note that everything is the same but the FAKE is not there this time. Yesterday I was not worried beacuse it only requested for 3-4 pages, but today in a 4 hours period of time it requested > 3,000 pages ... yes, 3,000! that is too much for me, even regular Googlebot does not index my site that hard! The IPs are 66.249.65.178 and 66.249.66.49 .. before (with the FAKE version) it was using 66.249.66.79 only. Anybody seeing the same behavior? I was checking a little and it looks like it is following the links from my site map page. Other thing I noticed is that it is requesting the pages as http://www.mydomain.com/page.html and http://mydomain.com/page.html .. and as so far I know I have no incomming links without the www anywhere. My concern is if it is a real Googlebot or if the case is that somebody from the other side is just getting all my content, it was fine when I got jut 3-4 hits, but 3,000 in 4 hours!? this is no a human being using a cellphone. caspita.
A post I made to GG never made it past the mods
Mozilla/4.0 (MobilePhone SCP-5500/US/1.0) NetFront/3.0 MMP/2.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
Mozilla/4.0 (MobilePhone SCP-5500/US/1.0) NetFront/3.0 MMP/2.0 FAKE (compatible; Googlebot/2.1; +http://www.google.com/bot.html)