homepage Welcome to WebmasterWorld Guest from 54.226.43.155
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
Who is this?
Took a lot of bandwidth
spikedo55




msg:402686
 8:23 pm on Feb 10, 2003 (gmt 0)


phoenix.formysite.com and 64.58.47.2

These two consumed a lot of my bandwidth on my site. I don't know how to trace or track them. CAn anyone offers some clues as to who and why they are hitting my site?

 

oilman




msg:402687
 8:31 pm on Feb 10, 2003 (gmt 0)

looks like it traces back to an ISP in Oklahoma. Prolly a homespun spider that pulled you site down. Do you have a user agent for this guy?

spikedo55




msg:402688
 9:55 pm on Feb 10, 2003 (gmt 0)

What's a user agent?

Finder




msg:402689
 7:30 pm on Feb 11, 2003 (gmt 0)

For example: "Mozilla/5.0 (Windows; U; Win98; en-US; rv:1.2.1) Gecko/20021130" is the User Agent for my Mozilla browser.

Legitimate spiders usually have a recognizable UA. Google's spider is "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"

Nosy or homemade spiders often have no UA at all, or a phony one. Analyzing the UA is the first step to figuring out who your mysterious visitor was.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved