webclipping.com - anyone heard of this?

[jetsetter]

I've been getting deep spidering from webclipping.com for the past week (every day).

They don't respond to my emails on configuration of robots.txt for exclusion.

Anyone use them, heard of them, etc.?

(I just banned their IP from my domain until they write back...)

[jimmykav]

try this [webclipping.com...]

[jetsetter]

Thanks for the link.

I investigated their site heavily trying to find out information about their spider, but found none.

I just don't want them spidering my site everyday, and I want them to obey my robots.txt file.

[glauber]

Well, if they're trying to combat misinformation on the web, they probably won't obey robots.txt, because if they did you could then just hide from them all your pages where you want to propagate misinformation, no?

g.

[Brett_Tabke]

I've detected many of those services monitoring posts here at WebmasterWorld. The most humorus is someone is monitoring RC's famous DotComMorgue posts. I guess they are watching to see if they still have a job. They probably figure they will hear about it here first.

Stopping those types of recurring bandwidth users can be tough. Ip htaccess ban is the only way to do it really. The ones that are the worst, are the image diggers that look for logo usage.