homepage Welcome to WebmasterWorld Guest from 54.161.246.212
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
www.netlinea.com Spider
Froggyman



 
Msg#: 447 posted 7:34 pm on Mar 11, 2001 (gmt 0)

Just reporting a new(?) spider. Doesn't seem to follow the RES.

Theme-based directory spider

IP: 194.98.184.201
UA: www.netlinea.com Spider
[netlinea.com...]

 

Brett_Tabke

WebmasterWorld Administrator brett_tabke us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 447 posted 9:33 am on Mar 12, 2001 (gmt 0)

Since it is a directory, I'll forgive them. Did it spider the whole site?

Froggyman



 
Msg#: 447 posted 3:05 am on Mar 13, 2001 (gmt 0)

Nope, just the home page. Maybe it'll come back for more later. I'll keep you posted.

Laurent

10+ Year Member



 
Msg#: 447 posted 10:58 am on Mar 17, 2001 (gmt 0)

hi !

Netlinea is a french ASP.

Netlinea develop private directory and/or private search engines for your site

You can have your list of urls and they crawle them for you.

Also, if you see the netlinea robots, it's because some of their clients integrate your site in their database. ;-)

Hope this help

Laurent

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved