homepage Welcome to WebmasterWorld Guest from 54.166.111.111
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
Can't figure this one out.
Why_me




msg:401029
 12:55 pm on Feb 14, 2000 (gmt 0)

Looking through my logs i've just noticed an ip# 129.10.52.127 (northeastern university boston) taking a massive 21% of one of my sites bandwidth in the last week; 8% the previous week and no hits before that. Any ideas of how to find what that ip is taking or leaching on to.
Regards
John

 

Brett_Tabke




msg:401030
 10:17 am on Feb 16, 2000 (gmt 0)

It all depends upon what log setup you are using. If you have full access to your server logs, then you should be able to see what the spider or proxy is up too. You should also consider some sort of referral tracking device to see where the traffic is coming from.

Occasionally we get written up in a colleg course on search engine shere and we will get a large spike of traffic from some proxy server at a college while kids view the site from the comp sci labs.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved