homepage Welcome to WebmasterWorld Guest from 54.197.215.146
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Visit PubCon.com
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
Two spider owners that need slapped
Brett_Tabke




msg:397309
 11:41 am on Nov 21, 2000 (gmt 0)

Apparently crawling for Lycos Wap engine:

209.116.70.50 CrawlerBoy Pinpoint.com

It was hyper agressive following all links and cgi's. (the @$#! hit me up for 2 gig of bandwidth yesterday)

Another brain dead one that got caught in several loops trying to dl the ad banner code on everypage:

avilink.net 194.226.121.82 Mozilla/5.0 (compatible; MSIE 5.0)

 

Machiavelli




msg:397310
 11:53 am on Nov 21, 2000 (gmt 0)

Brett - do you think that the first one is genuinely from pinpoint.com? I can't get much information on the IP address that's all, and any information I can find doesn't point at pinpoint or lycos.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved