Forum Moderators: open

Message Too Old, No Replies

niXXiebot

Takes robots.txt before every page.

         

GaryK

7:33 pm on Jan 31, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



User Agent:
niXXiebot Foster 1.1 (http://www.nixxie.com/display.php?section=Spiders)

IP:
209.59.14.nnn
inetnnnn.inetservices.com

Before it read each page it requested robots.txt. It took 36,000 pages with an average of five large pix per page before my bot blocker kicked in. To its credit it did respect robots.txt and it took pages slowly enough that it didn't trigger any of the usual alarms.

The site claims to be the UKs first contextual advertising company.

wilderness

3:09 am on Feb 1, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Many thanks Gary.

There are significant portions of the Class C of that particular Class B that are unassigned ranges.

Quite pecuilar for that Class A.

GaryK

4:15 am on Feb 1, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



You're welcome.

Right after I hit submit I found a variation on this user agent that did the same thing: niXXiebot-Foster.

What's peculiar about the unassigned ranges please?

wilderness

5:15 am on Feb 1, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



What's peculiar about the unassigned ranges please?

Just that they are unassigned in the 209 Class A.

16-32 Class C of this Class B unassigned.
48-63 Class C of this Class B unassigned.