Forum Moderators: open

Message Too Old, No Replies

Crawlerbot run by Yelp

         

keyplyr

8:16 am on Jun 27, 2015 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month





UA: Mozilla/5.0/Nutch-1.6 (Crawlerbot run by Yelp Inc; yelpbot at yelp dot com)
robots.txt: Yes
Host: AWS
54.160.0.0/11
54.160.0.0 - 54.191.255.255

Since I block Nutch & AWS, but value Yelp as a business trust factor (especially w/ Bing) I'll poke yet another hole.

topr8

8:52 am on Oct 30, 2015 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



i have a variation on the UA.

UA: Mozilla/5.0 compatible; yelpspider/yelpspider-1.0 (Crawlerbot run by Yelp Inc; yelpbot at yelp dot com)
robots.txt: Yes
Host: AWS
54.214.130.184

i can't find any info on the yelp site about the bot