Welcome to WebmasterWorld Guest from 54.147.20.131

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

Googlebot-richsnippets

     

Pfui

12:08 am on Jan 7, 2012 (gmt 0)

WebmasterWorld Senior Member 5+ Year Member



This showed up when I was testing a Google+ Profile Author link -- I think. Yet another Google oddity, particularly the second one,second one...

74.125.52.83
Googlebot-richsnippets
04:31:09 /welcome.html

74.125.52.89
Googlebot-richsnippets,Googlebot-richsnippets
04:31:10 /dir/filename.html

No robots.txt, of course. It's been a _l_o_n_g_ time since ANY of the scores of Google bots other than the official Googlebot from .googlebot.com even request it.

lucy24

2:37 am on Jan 7, 2012 (gmt 0)

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time Top Contributors Of The Month



You could wait until the cows come home for Googlebot-Image to ask for robots.txt in its own name. But all the different googlebots talk to each other, so I think the question is whether richsnippets considers itself a robot or not. Yes, yes, OK: whether the humans who programmed it included a directive to obey robots.txt.

The name suggests it comes down on the "robots" side. (Preview and Translate don't. In the case of Translate, I've verified this by direct experiment. In the case of Preview, a loaded htaccess still beats a robots.txt file.)

Any way to test whether it obeys "nofollow"?
 

Featured Threads

Hot Threads This Week

Hot Threads This Month