Welcome to WebmasterWorld Guest from

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

www.netlinea.com Spider



7:34 pm on Mar 11, 2001 (gmt 0)

Just reporting a new(?) spider. Doesn't seem to follow the RES.

Theme-based directory spider

UA: www.netlinea.com Spider


9:33 am on Mar 12, 2001 (gmt 0)

WebmasterWorld Administrator brett_tabke is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

Since it is a directory, I'll forgive them. Did it spider the whole site?


3:05 am on Mar 13, 2001 (gmt 0)

Nope, just the home page. Maybe it'll come back for more later. I'll keep you posted.


10:58 am on Mar 17, 2001 (gmt 0)

10+ Year Member

hi !

Netlinea is a french ASP.

Netlinea develop private directory and/or private search engines for your site

You can have your list of urls and they crawle them for you.

Also, if you see the netlinea robots, it's because some of their clients integrate your site in their database. ;-)

Hope this help



Featured Threads

Hot Threads This Week

Hot Threads This Month