Welcome to WebmasterWorld Guest from 54.226.238.178

Forum Moderated by: Ocean10000 & incrediBILL & keyplyr

Search Engine Spider and User Agent Identification


PreModerated forum to id search engine spiders

 
Thread SubjectMessagesStarted byLast Message
LNSpiderguy
lexis-nexis.com
9 idiotgirl 12:26 am Mar 16, 2002
New Apache Mpodule to catch 'evil spiders'
3 skirril 7:26 pm Mar 13, 2002
SpiderTrap Caught these IPs
Some are proxies, am I losing traffic?
18 prozz 1:03 am Mar 13, 2002
A new agent or new advertisement?
Multiblocker
24 Tapolyai 1:23 am Mar 11, 2002
Robot exclusion protocol..
2 skirril 6:18 am Mar 10, 2002
Scooter/1.0
Lets do the timewarp, again...
5 Josk 7:19 pm Mar 9, 2002
BunnySlippers
from Microsoft?
4 Machiavelli 7:14 pm Mar 9, 2002
myEfinder
looks like somebody's building a new engine?
3 volatilegx 4:36 pm Mar 7, 2002
can somebody tell me if these IPs are bots or legit website visitors
they constantly show up in top 10 IPs
4 prozz 12:13 am Mar 7, 2002
Ideare
an Italian Inktomi?
3 volatilegx 7:13 pm Mar 6, 2002
dtSearchSpider
3 volatilegx 4:58 pm Mar 6, 2002
61.146.48.44
China again....
2 Key_Master 6:58 am Mar 6, 2002
nat.overture.com
it is true, i see it requesting pages
4 EliteWeb 12:50 am Mar 6, 2002
Scooter took the css-file
2 oLeon 10:10 am Mar 5, 2002
openfind data gatherer
different IP's
4 wilderness 10:02 am Mar 5, 2002
Lockstep Spider?
Anything?
3 zeb 5:34 pm Mar 2, 2002
Fast 3.4 Nirvana - another new one?
2 Crazy_Fool 5:29 pm Mar 2, 2002
Inktomi slurp
i want to know how does slurp work
2 sakura 7:36 pm Mar 1, 2002
210.187.13.114
Spider crawls message boards.
7 Key_Master 8:13 pm Feb 28, 2002
Quail
Checking Google adwords?
2 rjohara 7:36 pm Feb 28, 2002
Scooter-3.2.DIL
15 Crazy_Fool 5:49 pm Feb 27, 2002
W8 Search
looks like a new small search engine?
4 volatilegx 5:32 pm Feb 26, 2002
New AV spider?
4 Ove 11:02 pm Feb 25, 2002
Slurp Adhoc?
Is this a new one?
1 makemetop 11:51 am Feb 23, 2002
gigabaz
5 Son_House 12:19 am Feb 21, 2002