Welcome to WebmasterWorld Guest from 22.214.171.124
I'm not interested
Update October 2013: The new Googlebot-Mobile for smartphones user-agent is: Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 (KHTML, like Gecko) Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)
The content crawled by smartphone Googlebot-Mobile will be used primarily to improve the user experience on mobile search. For example, the new crawler may discover content specifically optimized to be browsed on smartphones as well as smartphone-specific redirects.
One new feature we’re also launching that uses these signals is Skip Redirect for Smartphone-Optimized Pages. When we discover a URL in our search results that redirects smartphone users to another URL serving smartphone-optimized content, we change the link target shown in the search results to point directly to the final destination URL. This removes the extra latency the redirect introduces leading to a saving of 0.5-1 seconds on average when visiting landing page for such search results. Update 9 August 2013: If a site uses separate URLs to serve desktop and smartphone users, and if we discover accurate rel-alternate-media annotations linking the desktop and smartphone pages, our algorithms may change the link target shown in the search results to point directly to the smartphone page.
In other words, the UA name element -Mobile is conspicious by its absence?
There is growing speculation that if your site is not optimized for mobile screens, it will not do well in the mobile SERP in the very near future (if not already.)
If your site does not offer different content to smartphones then you may not need the extra crawls.
This thing has gained a healthier appetite since eating 403's.
joined:Dec 27, 2006
May be of interest and somewhat relevant: I've just heard that G is going to give priority in the index to SSL sites. If true that should lock out a lot of good web sites. Not sure how that fits with mobile devices and non-SSL web sites.
they no longer will disclose what IPs they crawl from, to prevent whitelisting
(?<!Mozilla/5.0 \(compatible; |")Googlebot
Does the omission of "-Mobile" from the iPhone version (only) mean that smartphones have become so mainstream, there's no longer any reason to call yourself a Modified Googlebot?
joined:Apr 25, 2012
I haven't tried "Don's Unique Widgets", though.
I doubt that I would be allowed in.
and so remains a modified Googlebot
joined:Apr 25, 2012
I am wondering if mine qualify.
There is no mention of "Googlebot" because it isn't Googlebot.
There is no proof that it isn't Googlebot