Google Robots Visit Down - MSN Up

How does it happen

[digic]

When I first launced my site last September of 2005, Google indexed my new pages very past and the ration of MSN vs. Google robots visit is 1:2, meaning Google visits my site twice than MSN does. My new articles are indexed by Google for not more than 4days or less, now after 2 weeks of uploading my new articles, it wasnt indexed yet.

Now it was reversed. MSN vs Google is 2:1. How did it happen, Are there any way to make it equal.

[caveman]

<bump>

Anyone have thoughts?

;-)

[Robert Charlton]

Anyone have thoughts?

I'm not sure this is the answer, but Matt Cutts had this to say on his blog several days ago...

Q & A thread: March 27, 2006

Q: "What’s the story on the Mozilla Googlebot? Is that what Bigdaddy sends out?"

A: Yes, I believe so. You will probably see less crawling by the older Googlebot, which has a User-Agent of "Googlebot/2.1 (+http://www.google.com/bot.html)". I believe crawling from the Bigdaddy infrastructure has a new User-Agent, which is “Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"

[edited by: caveman at 5:15 am (utc) on April 3, 2006]

[BarHopper]

My thoughts....

Google is changing their algorythm to support stronger site analytics. There is a lot of reporting in google's analytics software that doesnt get picked up by its current crawl, and my guess is that they are still running some crawlers but are decreasing so that information doesnt keep getting trapped in analytics that is false....I have a reliable source that has explained this to me...but once again it could all be a lie...just thought id throw that in there. And yes, google crawler has dropped about 40% crawl rate on my sites and MSN seems to be moving up..I wonder how much crap MSN is filled with now..lol

-Bar