Forum Moderators: open

Message Too Old, No Replies

SmartViper

another SEO scraper

         

incrediBILL

7:50 pm on May 7, 2010 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



The SmartViper engine [smartviper.com] claims to be going live in August

The author has a BOT page that claims is uses robots.txt:
[markosweb.com...]

However, when it hit my site it didn't identify itself as anything but Firefox:

"Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.0.18) Gecko/2010021718 CentOS/3.0.18-1.el5.centos Firefox/3.0.18"

It made a screen shot plus used content from the page it downloaded.

It's hosted at 1&1 Internet in this range 74.208.43.*

keyplyr

10:30 pm on May 7, 2010 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



1&1 is a cheapo hosting that seems to allow anything. I've had them blocked for ages: 74.208.0.0/16

incrediBILL

11:12 pm on May 7, 2010 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



There's hard blocking and soft blocking.

I block them from my site in software but issue a tracking page so I can see where the content would go assuming I let them take it.

Sometimes it takes up to a year before this stuff shows up in Google!

keyplyr

12:18 am on May 8, 2010 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



You're a better man than I Gunga Din.

incrediBILL

12:43 am on May 8, 2010 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Nah.

Just hell bent on finding out who takes things without using proper user agents.

I like to hunt them down like a dog and sniff them out so that others know where it's coming from and where it's going.

In other words "Do unto stealth as stealth would do unto you!" :)

What I do is really no different than any other type of honeypot.

You just have to be patient and wait and see where the bees deposit the honey is all.