Page is a not externally linkable
- Google
-- Google SEO News and Discussion
---- Questioning the wisdom of using fat pings to deal with scrapers


TheMadScientist - 8:59 am on Nov 22, 2012 (gmt 0)


Fascinating...

When I ran a test to see what I go from tweeting a link the 'interesting' visits were (via either IP or User Agent) the following:

Topsy (Butterfly)
TweetMeMe
Microsoft (IE 7.0 User Agent - Microsoft via IP Address)
Amazon AWS (x 2)
TwitterBot

So, TopsyLabs, TweetMeMe, Some 'oddly identified' Microsoft Bot, 2 x Amazon hosted bots (1 identified as "JS-Kit URL Resolver", 1 identified as "Mozilla/5.0 (compatible NN.NN.NN.NNN" - Yes, it was identified as a partial user agent) and TwitterBot found the URL within Seconds, but after 5 minutes there was no GoogleBot...

I'm glad someone pointed this out, because I would not have ever thought to double check and see if the largest search engine on the planet could find a URL from a tweet on Twitter when I Know if I don't block them Amazon bots can and do.

Seriously? A 'minibot' (compared to GBot) can find a tweet within seconds, but somehow GBot can't? You Gotta Be Kidding Me ... Maybe GoogleBot's low on funding? Er, uh, wait they're G$$gle.


Thread source:: http://www.webmasterworld.com/google/4520212.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com