| Welcome to WebmasterWorld Guest from 188.8.131.52 |
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
|Subscribe and Support WebmasterWorld|
| 7:34 pm on Mar 11, 2001 (gmt 0)|
Just reporting a new(?) spider. Doesn't seem to follow the RES.
Theme-based directory spider
UA: www.netlinea.com Spider
| 9:33 am on Mar 12, 2001 (gmt 0)|
Since it is a directory, I'll forgive them. Did it spider the whole site?
| 3:05 am on Mar 13, 2001 (gmt 0)|
Nope, just the home page. Maybe it'll come back for more later. I'll keep you posted.
| 10:58 am on Mar 17, 2001 (gmt 0)|
Netlinea is a french ASP.
Netlinea develop private directory and/or private search engines for your site
You can have your list of urls and they crawle them for you.
Also, if you see the netlinea robots, it's because some of their clients integrate your site in their database. ;-)
Hope this help
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
© Webmaster World 1996-2014 all rights reserved