Webclipping.com

Spider Information, Experiences & Known IP's

[Froggyman]

If they can watch and collect information on webmaster's then I think it's only fair for the webmaster's to collect information on them.

Webclipping.com
[webclipping.com...]

I am banning them today. They have been hitting everyday for as long as I can remember. Today was different- they came back for a second look. In my case, it is always accompanied by another follow up spider ( lwp-trivial/1.28 ). I assume this is the "payee". The hosting server the "payee's" site runs off of cost a minimum $1600.00 a month. In other words, a big company. I say, let them use a real browser to view my site for a change. Maybe they'll buy something, LOL.

Webclipping.com IP listing:

209.73.228.163
209.73.228.167

[Brett_Tabke]

Thank you for the ip's. That one hadn't shown up on the radar yet. After digging for it, I found it on most sites. Banned em.

This is one everyone should ban. They are reselling your content without your consent.

[oLeon]

We´ve been hit by this Webclipping-robot, but I have to concede I don´t understand what this company want.
Okay, they collect information which they want to pass to another without asking the owner of these datas.
But why should they spider the pages after they had have a look at them?

BTW: Do you know other companies doing the same which I have to ban, too?

[idiotgirl]

compete.com basically does the same thing. They typically use larbin as a crawler. I banned them for the same fundamental reasons.

[GWJ]

Hi,

Would I do this in the robots.txt? If so what would the syntax be?

Thank you,

Brian

[Key_Master]

If webclipping.com obeys robots.txt (which is a very remote possibility IMHO), they aren't telling how.