Forum Moderators: open

Message Too Old, No Replies

OnetSzukaj

bot out of poland - hungry one too

         

Bewenched

7:45 pm on May 3, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



213.180.137.xx (Kraków,Pahang,Poland)May/01/2008 03:18:27/robots.txt569200 - OKNo Referrerholmes/3.12 (OnetSzukaj/5.0; [szukaj.onet.pl)...]

Ocean10000

3:28 pm on May 4, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I have seen more then a few variations from this spider over the years, here are a few. They all supply the same email address in the From Header is how I match them all together.

  • holmes/3.10.1 (OnetSzukaj/5.0; +http://szukaj.onet.pl)
  • holmes/3.9 (onet.pl)
  • holmes/3.9 (OnetSzukaj/5.0; +http://szukaj.onet.pl)
  • Mozilla/5.0 (compatible; OnetSzukaj/5.0; +http://szukaj.onet.pl
  • Mozilla/5.0 (compatible; OnetSzukaj/5.0; +http://szukaj.onet.pl)

I have only seen it use about 5 ips in that subnet total, but doesn't mean its not using them all, just that I haven't seen them used on my site.

On my site it obeys Robots.txt, which it takes first then leaves since it is denied in it.