Welcome to WebmasterWorld Guest from 54.145.208.64

Forum Moderated by: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification


PreModerated forum to id search engine spiders

 
Thread SubjectMessagesStarted byLast Message
Obnoxious behavior from 63.86.155.41
Can't track it down...
6 mivox 6:46 pm Dec 7, 2000
Fast? Crawler
Strange
5 BoneHeadicus 3:14 pm Dec 3, 2000
Microsoft URL Control
what was it that littleman said?
2 han solo 5:52 pm Nov 30, 2000
possible spider...
216.161.154.93 ua Mozilla/4.0+(compatible;+MSIE+5.0;+Windows
7 han solo 2:50 pm Nov 30, 2000
Ink / PositionTech spider
1 oLeon 2:04 pm Nov 30, 2000
Is this ink?
62.252.160.5 ip looks up to inktomi2-lan.server.ntl.com
7 han solo 4:38 pm Nov 29, 2000
Smart Whois
2 BoneHeadicus 4:27 pm Nov 28, 2000
Apache Guardian
2 BoneHeadicus 8:26 pm Nov 25, 2000
LexiBot/1.00
who is this?
3 han solo 2:29 pm Nov 24, 2000
JennyBot
Who is she?
8 scott 11:13 am Nov 24, 2000
PJSPider
2 Abe 4:13 pm Nov 21, 2000
SpaceBison/0.01
any ideas/thoughts?
4 han solo 3:15 pm Nov 21, 2000
Two spider owners that need slapped
2 Brett_Tabke 11:53 am Nov 21, 2000
12.25.194.37 is a surfer, or spider?
tracert shows velocity isp company...
4 han solo 4:58 pm Nov 20, 2000
Good identification spider book?
Spiders
7 Melanie 7:59 am Nov 19, 2000
Who is this
cm-24-161-36-192.nycap.rr.com
2 stcrim 8:47 am Nov 17, 2000
mass banning spiders
I am considering blocking all spiders...
3 han solo 2:28 pm Nov 16, 2000
Haven't seen this slurp before
2 eljefe3 5:37 am Nov 10, 2000
Anyone Seen This Crawler
1 redzone 6:40 pm Nov 8, 2000
Inktomi User Agent change
..if anyone still cares
5 Air 9:01 am Nov 7, 2000
LEIAcrawler?
2 Ulrike 1:49 pm Nov 2, 2000
164.124.250.214
164.124.250.214
5 roscoepico 8:48 pm Nov 1, 2000
What is this all about?
4 eljefe3 8:46 pm Nov 1, 2000
List of User Agents
3 tollervey 4:33 pm Nov 1, 2000
WebLab
question
2 Mike_Mackin 2:52 pm Nov 1, 2000