Forum Moderators: open

Message Too Old, No Replies

A few new ones I haven't seen before...

Anyone know who they are?

         

SEO Speedster

2:14 pm on Nov 16, 2001 (gmt 0)



NationalDirectory-WebSpider/1.3

Harvest/HARVEST_VERSION

FUX_Page_Loader/1.*

lwp-trivial/1.*

...I have never seen them before, and cannot find any more information on them.

Thanks for any info

~Speedster

idiotgirl

10:06 am on Nov 17, 2001 (gmt 0)

10+ Year Member Top Contributors Of The Month



speedster - I've seen them, too. I could be dead wrong as far as memory serves me, but i think the NationalDirectory spider is for:

[nationaldirectory.com...]

which looks relatively harmless. Almost google-like with more window dressing.

Don't know about Harvest. I think I reversed the IP a long time ago but don't recall. IMHO - anything with 'harvest' in the name that spiders a site is suspicious. I subscribe to the, "If I can't identify it - kill it" theory when it comes to any kind of spiders, online or off.

starec

2:38 pm on Nov 17, 2001 (gmt 0)

10+ Year Member



[robotstxt.org...]
It's opensource (I think) and it's being used for all kind of things. I've blocked its generic form in robots.txt (works fine) and asked the ***** (using our site in their topical search project pilot) to change the identification string of the harvest bot if they want to spider us.

wilderness

12:52 am on Dec 9, 2001 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



<snip>
lwp-trivial/1.*

deny from 209.94. lwp-trivial/1.32, 209.94.73.132, Zero Error Networks, 11/24/01

Zero Error Networks (ASN-AMIGO-NET) AMIGO-NET 10446
Zero Error Networks (NETBLK-ZEROERROR) ZEROERROR 209.12.190.0 - 209.12.190.255
Zero Error Networks (NETBLK-AMIGO-NET) AMIGO-NET 209.94.64.0 - 209.94.95.255
end of quote

Neither the bot or the website provide any information.
IMO no information is BAD information.
What are their motives?
Why aren't their making their motives for visiting your site and using your resources known?