homepage Welcome to WebmasterWorld Guest from 54.226.191.80
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
Merchant Centric Bot
Ken_S




msg:4588615
 8:58 pm on Jun 28, 2013 (gmt 0)

Brand new bot for me - came by once yesterday...

From: Amazon, Rackspace, ServePath, Softlayer

############

184.72.170.3x - - [28/Jun/2013:09:05:34 -0700] "GET /robots.txt HTTP/1.0" 200 482 "-" "Python-urllib/1.17"
184.72.170.3x - - [28/Jun/2013:09:05:34 -0700] "GET / HTTP/1.1" 403 3478 "-" "Mozilla/5.0 (compatible; MerchantCentricBot/1.0)"

23.23.15.9x - - [28/Jun/2013:09:10:29 -0700] "GET /robots.txt HTTP/1.0" 200 482 "-" "Python-urllib/1.17"
23.23.15.9x - - [28/Jun/2013:09:10:29 -0700] "GET / HTTP/1.1" 403 3478 "-" "Mozilla/5.0 (compatible; MerchantCentricBot/1.0)"

184.73.83.11x - - [28/Jun/2013:09:10:30 -0700] "GET /robots.txt HTTP/1.0" 200 482 "-" "Python-urllib/1.17"
184.73.83.11x - - [28/Jun/2013:09:10:30 -0700] "GET / HTTP/1.1" 403 3478 "-" "Mozilla/5.0 (compatible; MerchantCentricBot/1.0)"

50.17.10.13x - - [28/Jun/2013:09:10:38 -0700] "GET /robots.txt HTTP/1.0" 200 482 "-" "Python-urllib/1.17"

184.72.91.10x - - [28/Jun/2013:09:10:38 -0700] "GET /robots.txt HTTP/1.0" 200 482 "-" "Python-urllib/1.17"

50.17.10.13x - - [28/Jun/2013:09:10:38 -0700] "GET / HTTP/1.1" 403 3478 "-" "Mozilla/5.0 (compatible; MerchantCentricBot/1.0)"

184.72.91.10x - - [28/Jun/2013:09:10:38 -0700] "GET / HTTP/1.1" 403 3478 "-" "Mozilla/5.0 (compatible; MerchantCentricBot/1.0)"

198.101.244.15x - - [28/Jun/2013:09:10:58 -0700] "GET /robots.txt HTTP/1.0" 200 482 "-" "Python-urllib/1.17"
198.101.244.15x - - [28/Jun/2013:09:10:58 -0700] "GET / HTTP/1.1" 403 3478 "-" "Mozilla/5.0 (compatible; MerchantCentricBot/1.0)"

50.17.109.10x - - [28/Jun/2013:09:11:20 -0700] "GET /robots.txt HTTP/1.0" 200 482 "-" "Python-urllib/1.17"
50.17.109.10x - - [28/Jun/2013:09:11:20 -0700] "GET / HTTP/1.1" 403 3478 "-" "Mozilla/5.0 (compatible; MerchantCentricBot/1.0)"

184.73.1.6x - - [28/Jun/2013:09:11:30 -0700] "GET /robots.txt HTTP/1.0" 200 482 "-" "Python-urllib/1.17"
184.73.1.6x - - [28/Jun/2013:09:11:30 -0700] "GET / HTTP/1.1" 403 3478 "-" "Mozilla/5.0 (compatible; MerchantCentricBot/1.0)"

166.78.0.11x - - [28/Jun/2013:09:14:24 -0700] "GET /robots.txt HTTP/1.0" 200 482 "-" "Python-urllib/1.17"
166.78.0.11x - - [28/Jun/2013:09:14:24 -0700] "GET / HTTP/1.1" 403 3478 "-" "Mozilla/5.0 (compatible; MerchantCentricBot/1.0)"

204.51.149.16x - - [28/Jun/2013:09:15:41 -0700] "GET /robots.txt HTTP/1.0" 200 482 "-" "Python-urllib/1.17"
204.51.149.16x - - [28/Jun/2013:09:15:41 -0700] "GET / HTTP/1.1" 403 3478 "-" "Mozilla/5.0 (compatible; MerchantCentricBot/1.0)"

50.97.247.22x - - [28/Jun/2013:09:17:34 -0700] "GET /robots.txt HTTP/1.0" 200 482 "-" "Python-urllib/1.17"
50.97.247.22x - - [28/Jun/2013:09:17:34 -0700] "GET / HTTP/1.1" 403 3478 "-" "Mozilla/5.0 (compatible; MerchantCentricBot/1.0)"

108.168.227.14x - - [28/Jun/2013:09:18:58 -0700] "GET /robots.txt HTTP/1.0" 200 482 "-" "Python-urllib/1.17"
108.168.227.14x - - [28/Jun/2013:09:18:58 -0700] "GET / HTTP/1.1" 403 3478 "-" "Mozilla/5.0 (compatible; MerchantCentricBot/1.0)"

50.97.216.6x - - [28/Jun/2013:09:19:59 -0700] "GET /robots.txt HTTP/1.0" 200 482 "-" "Python-urllib/1.17"
50.97.216.6x - - [28/Jun/2013:09:19:59 -0700] "GET / HTTP/1.1" 403 3478 "-" "Mozilla/5.0 (compatible; MerchantCentricBot/1.0)"

23.20.73.24x - - [28/Jun/2013:09:20:37 -0700] "GET /robots.txt HTTP/1.0" 200 482 "-" "Python-urllib/1.17"
23.20.73.24x - - [28/Jun/2013:09:20:37 -0700] "GET / HTTP/1.1" 403 3478 "-" "Mozilla/5.0 (compatible; MerchantCentricBot/1.0)"

107.21.147.18x - - [28/Jun/2013:09:20:39 -0700] "GET /robots.txt HTTP/1.0" 200 482 "-" "Python-urllib/1.17"
107.21.147.18x - - [28/Jun/2013:09:20:39 -0700] "GET / HTTP/1.1" 403 3478 "-" "Mozilla/5.0 (compatible; MerchantCentricBot/1.0)"

184.73.97.9x - - [28/Jun/2013:09:20:49 -0700] "GET /robots.txt HTTP/1.0" 200 482 "-" "Python-urllib/1.17"
184.73.97.9x - - [28/Jun/2013:09:20:50 -0700] "GET / HTTP/1.1" 403 3478 "-" "Mozilla/5.0 (compatible; MerchantCentricBot/1.0)"

75.101.225.16x - - [28/Jun/2013:09:20:54 -0700] "GET /robots.txt HTTP/1.0" 200 482 "-" "Python-urllib/1.17"
75.101.225.16x - - [28/Jun/2013:09:20:54 -0700] "GET / HTTP/1.1" 403 3478 "-" "Mozilla/5.0 (compatible; MerchantCentricBot/1.0)"

50.97.194.1x - - [28/Jun/2013:09:24:48 -0700] "GET /robots.txt HTTP/1.0" 200 482 "-" "Python-urllib/1.17"
50.97.194.1x - - [28/Jun/2013:09:24:48 -0700] "GET / HTTP/1.1" 403 3478 "-" "Mozilla/5.0 (compatible; MerchantCentricBot/1.0)"

23.23.39.5x - - [28/Jun/2013:09:25:13 -0700] "GET /robots.txt HTTP/1.0" 200 482 "-" "Python-urllib/1.17"
23.23.39.5x - - [28/Jun/2013:09:25:13 -0700] "GET / HTTP/1.1" 403 3478 "-" "Mozilla/5.0 (compatible; MerchantCentricBot/1.0)"

184.72.170.3x - - [28/Jun/2013:09:25:59 -0700] "GET /robots.txt HTTP/1.0" 200 482 "-" "Python-urllib/1.17"
184.72.170.3x - - [28/Jun/2013:09:25:59 -0700] "GET / HTTP/1.1" 403 3478 "-" "Mozilla/5.0 (compatible; MerchantCentricBot/1.0)"

23.20.76.13x - - [28/Jun/2013:09:27:05 -0700] "GET /robots.txt HTTP/1.0" 200 482 "-" "Python-urllib/1.17"
23.20.76.13x - - [28/Jun/2013:09:27:05 -0700] "GET / HTTP/1.1" 403 3478 "-" "Mozilla/5.0 (compatible; MerchantCentricBot/1.0)"

166.78.26.18x - - [28/Jun/2013:09:27:43 -0700] "GET /robots.txt HTTP/1.0" 200 482 "-" "Python-urllib/1.17"
166.78.26.18x - - [28/Jun/2013:09:27:43 -0700] "GET / HTTP/1.1" 403 3478 "-" "Mozilla/5.0 (compatible; /1.0)"

174.129.93.10x - - [28/Jun/2013:09:30:48 -0700] "GET /robots.txt HTTP/1.0" 200 482 "-" "Python-urllib/1.17"
174.129.93.10x - - [28/Jun/2013:09:30:48 -0700] "GET / HTTP/1.1" 403 3478 "-" "Mozilla/5.0 (compatible; MerchantCentricBot/1.0)"

50.97.216.6x - - [28/Jun/2013:09:32:20 -0700] "GET /robots.txt HTTP/1.0" 200 482 "-" "Python-urllib/1.17"
50.97.216.6x - - [28/Jun/2013:09:32:20 -0700] "GET / HTTP/1.1" 403 3478 "-" "Mozilla/5.0 (compatible; MerchantCentricBot/1.0)"

204.51.149.16x - - [28/Jun/2013:09:35:23 -0700] "GET /robots.txt HTTP/1.0" 200 482 "-" "Python-urllib/1.17"
204.51.149.16x - - [28/Jun/2013:09:35:23 -0700] "GET / HTTP/1.1" 403 3478 "-" "Mozilla/5.0 (compatible; MerchantCentricBot/1.0)"

107.20.62.3x - - [28/Jun/2013:09:41:28 -0700] "GET /robots.txt HTTP/1.0" 200 482 "-" "Python-urllib/1.17"
107.20.62.3x - - [28/Jun/2013:09:41:29 -0700] "GET / HTTP/1.1" 403 3478 "-" "Mozilla/5.0 (compatible; MerchantCentricBot/1.0)"

198.101.244.21x - - [28/Jun/2013:09:45:06 -0700] "GET /robots.txt HTTP/1.0" 200 482 "-" "Python-urllib/1.17"
198.101.244.21x - - [28/Jun/2013:09:45:07 -0700] "GET / HTTP/1.1" 403 3478 "-" "Mozilla/5.0 (compatible; MerchantCentricBot/1.0)"

 

wilderness




msg:4588658
 2:51 am on Jun 29, 2013 (gmt 0)

Amazon AWS [webmasterworld.com]

lucy24




msg:4588664
 3:40 am on Jun 29, 2013 (gmt 0)

I love truthful names in robots :)

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved