Welcome to WebmasterWorld Guest from 54.162.167.40

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

ScooperBot

     
2:03 am on Aug 25, 2011 (gmt 0)

WebmasterWorld Senior Member 5+ Year Member



"CustomScoop, a leader in Media Intelligence, delivers customizable media monitoring technology and analysis..."

...and runs a bot that does not heed the robots.txt files it pretends to read:

server41.customscoop.com
ScooperBot www.customscoop.com

08/24 1n:43:30 /robots.txt
08/24 1n:43:31 /
08/24 1n:43:32 /robots.txt

Scoop this:

User-agent: *
Disallow: /
7:08 am on Aug 25, 2011 (gmt 0)

5+ Year Member



Pfui wrote:
server41.customscoop.com


Seems to be hosted on Rackspace: 64.49.241.205

CustomScoop RACKS-8-1297789565269605 (NET-64-49-241-192-1) 64.49.241.192 - 64.49.241.223
Rackspace Hosting RSPC-NET-3 (NET-64-49-192-0-1) 64.49.192.0 - 64.49.255.255

They also use at least one GoDaddy IP: 72.167.3.1

CIDR 72.167.0.0/22

(Both ranges I already had blocked, from long ago)
2:46 pm on Sep 1, 2011 (gmt 0)

WebmasterWorld Senior Member 5+ Year Member



Same server farm, same double-tap feint:

server34.customscoop.com
ScooperBot www.customscoop.com

09/01 0n:59:57 /robots.txt
09/01 0n:59:58 /302
09/01 0n:59:59 /robots.txt

FWIW
 

Featured Threads

Hot Threads This Week

Hot Threads This Month