Welcome to WebmasterWorld Guest from

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies


2:03 am on Aug 25, 2011 (gmt 0)

WebmasterWorld Senior Member 5+ Year Member

"CustomScoop, a leader in Media Intelligence, delivers customizable media monitoring technology and analysis..."

...and runs a bot that does not heed the robots.txt files it pretends to read:

ScooperBot www.customscoop.com

08/24 1n:43:30 /robots.txt
08/24 1n:43:31 /
08/24 1n:43:32 /robots.txt

Scoop this:

User-agent: *
Disallow: /
7:08 am on Aug 25, 2011 (gmt 0)

5+ Year Member

Pfui wrote:

Seems to be hosted on Rackspace:

CustomScoop RACKS-8-1297789565269605 (NET-64-49-241-192-1) -
Rackspace Hosting RSPC-NET-3 (NET-64-49-192-0-1) -

They also use at least one GoDaddy IP:


(Both ranges I already had blocked, from long ago)
2:46 pm on Sep 1, 2011 (gmt 0)

WebmasterWorld Senior Member 5+ Year Member

Same server farm, same double-tap feint:

ScooperBot www.customscoop.com

09/01 0n:59:57 /robots.txt
09/01 0n:59:58 /302
09/01 0n:59:59 /robots.txt


Featured Threads

Hot Threads This Week

Hot Threads This Month