Googlebot with a Mozilla/5.0 Compatible User Agent

[ccton]

take a look at the user agent yourself, you will find the crazy bot is: Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

not the normal one: Googlebot/2.1 (+http://www.google.com/bot.html)

To my limited experience, the Mozilla/5.0 bot case only your pages being dropped or get titles and/or descriptions lost, pages crawled by this bot will not be shown on google's index.

Pages crawled by the normal bot without a Mozilla/5.0 prefix will be shown on google index.

Good luck to u all!

[digital]

I have noticed the same thing.. but I guess they are getting ready for a huge update!

For now only the pages crawled from the old bot get indexed, after a day or two..

[iProgram]

Is this a way to fight with cloaking? G sends two bots to the same URL, one is googlebot/2.1 and another is Mozilla/5.0. And then compare these two results?

[Slade]

I was thinking about the cloaking issue, but if they wanted to do that, wouldn't they just drop Googlebot from the string altogether?

I mean you're taking the chance that "Mozilla" is being searched for before "Googlebot", or that the pattern match is for the entire old Googlebot useragent. I doubt anyone that's working hard to cloak would have that simple of a match algorithm...

[digital]

The Mozilla Bot is the NEW Google bot, if they are going to check for cloaking, they will simply send for User-Agent, something that looks more like a regular surfer.

[bull]

Half a year old news
[webmasterworld.com...]