Welcome to WebmasterWorld Guest from 54.196.244.206

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

ScooperBot

     
2:03 am on Aug 25, 2011 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Nov 5, 2005
posts: 2038
votes: 1


"CustomScoop, a leader in Media Intelligence, delivers customizable media monitoring technology and analysis..."

...and runs a bot that does not heed the robots.txt files it pretends to read:

server41.customscoop.com
ScooperBot www.customscoop.com

08/24 1n:43:30 /robots.txt
08/24 1n:43:31 /
08/24 1n:43:32 /robots.txt

Scoop this:

User-agent: *
Disallow: /
7:08 am on Aug 25, 2011 (gmt 0)

Preferred Member

10+ Year Member

joined:Sept 21, 2005
posts: 379
votes: 0


Pfui wrote:
server41.customscoop.com


Seems to be hosted on Rackspace: 64.49.241.205

CustomScoop RACKS-8-1297789565269605 (NET-64-49-241-192-1) 64.49.241.192 - 64.49.241.223
Rackspace Hosting RSPC-NET-3 (NET-64-49-192-0-1) 64.49.192.0 - 64.49.255.255

They also use at least one GoDaddy IP: 72.167.3.1

CIDR 72.167.0.0/22

(Both ranges I already had blocked, from long ago)
2:46 pm on Sept 1, 2011 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Nov 5, 2005
posts: 2038
votes: 1


Same server farm, same double-tap feint:

server34.customscoop.com
ScooperBot www.customscoop.com

09/01 0n:59:57 /robots.txt
09/01 0n:59:58 /302
09/01 0n:59:59 /robots.txt

FWIW
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members