| Welcome to WebmasterWorld Guest from 188.8.131.52 |
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
|Become a Pro Member|
Just reporting a new(?) spider. Doesn't seem to follow the RES.
Theme-based directory spider
UA: www.netlinea.com Spider
Since it is a directory, I'll forgive them. Did it spider the whole site?
Nope, just the home page. Maybe it'll come back for more later. I'll keep you posted.
Netlinea is a french ASP.
Netlinea develop private directory and/or private search engines for your site
You can have your list of urls and they crawle them for you.
Also, if you see the netlinea robots, it's because some of their clients integrate your site in their database. ;-)
Hope this help
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved