Forum Moderators: open

Message Too Old, No Replies

SaladSpoon/ShopSalad

Bad bots never die, they just smell that way

         

Dijkgraaf

3:40 am on Jul 22, 2010 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



An old bot with an updated UA

UA: SaladSpoon/ShopSalad 1.0 (Search Engine crawler for ShopSalad.com;
http://shopsalad.com/en/partners.html
; crawler AT shopsalad.com)
robots.txt: yes
IP: 91.85.205.nnn

Old thread:
[webmasterworld.com...]

ProjectHoneypot reports the following UA's all came from the same IP.
BobCrawl/Nutch-0.9 (Test/Development crawler;
http://notavalable.com
; notavailable@notavailable.com)
SaladSpoon/ShopSalad 1.0 (Search Engine crawler for ShopSalad.com;
http://shopsalad.com/en/partners.html
; crawler AT shopsalad.com)
SaladSpoon/ShopSalad 1.0 (Search Engine crawler for ShopSalad.com;
http://shopsalad.com/en/partners.html
; crawler@shopsalad.com)
YowedoBot/Yowedo 1.0 (Search Engine crawler for yowedo.com;
http://yowedo.com/en/partners.html
; crawler@yowedo.com)

ShopSalad

11:47 am on Sep 13, 2010 (gmt 0)

10+ Year Member



Why do you call this a "bad bot"? Does it not comply with your robots.txt?

keyplyr

6:34 pm on Sep 13, 2010 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



This bot has always respected my robots.txt directives.

Dijkgraaf

10:00 pm on Sep 13, 2010 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I named it a bad bot due to comments in the old thread I linked too.

So far it has only hit 3 pages, all which have extensive external linking, including in DMOZ, which is apparently where they are getting their links from.

I haven't had a problem with it so haven't tried banning it.
However as I don't sell anything on my site, I'm tempted to ban them, as there is no purpose in their visits.