Forum Moderators: open

Message Too Old, No Replies

Exploratodo

         

keyplyr

6:52 am on Sep 13, 2015 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month





"GET /robots.txt HTTP/1.1" 200 3915 "-" "Mozilla/5.0 (compatible; Exploratodo/1.0; +http://www.exploratodo.com"

Current host: WholesaleInternet.com
173.208.128.0 - 173.208.255.255
173.208.128.0/17

Up until now I had the larger range of 173.208/16 (including Nobis) blocked so I can't comment on the bot's behavior. The SERP presentation looks clean but the index is small.

w3bmastine

2:07 pm on Jan 20, 2016 (gmt 0)

10+ Year Member



Bot came today, visiting from another IP, that's why I post it here.

192.151.154.130 - - [20/Jan/2016:01:56:53 +0100] "GET /robots.txt HTTP/1.1" 200 575 "-" "Mozilla/5.0 (compatible; Exploratodo/1.0; +http://www.exploratodo.com" "my.com"

Bot behaved. Obeyed robots.txt