Welcome to WebmasterWorld Guest from 54.205.251.179

Forum Moderated by: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification


PreModerated forum to id search engine spiders

 
Thread SubjectMessagesStarted byLast Message
C-macos8
4 wilderness 12:08 am Jul 21, 2002
flunky -- anyone seen this spider?
66.28.20.194 flunky -- crawling my sites.
16 gethan 10:52 pm Jul 20, 2002
JOC Web Spider
Another leech to ban...
1 Key_Master 9:56 pm Jul 20, 2002
Two new non-se spiders?
Convera Internet Spider V6.9 & Webdup/0.9
1 Dreamquick 1:01 pm Jul 20, 2002
add2.dir.scd.yahoo.com
4 smokin 10:21 pm Jul 19, 2002
Openfind
4 volatilegx 3:16 pm Jul 19, 2002
crawler3.wib.pa-x.dec.com ?
Anyone recognize this Spider?
5 24bit 4:33 am Jul 19, 2002
openfind wont go away....
6 Dpeper 11:05 pm Jul 18, 2002
Java1.3.1 user agent
grabbing pages via wireless network?
3 idiotgirl 1:36 pm Jul 18, 2002
Lachesis
venomous snake or weird bot?
3 idiotgirl 6:19 pm Jul 17, 2002
212.30.114.9
Does anyone know who this is ?
7 Visit_Thailand 1:10 pm Jul 17, 2002
spider.batsch.com
Does anyone have info on this spider?
5 smokin 6:32 pm Jul 16, 2002
64.29.137.164
this ring a bell for anyone?
3 Weblamer 5:41 pm Jul 16, 2002
64.140.48.30
Who should this be
6 BrunoDillen 5:28 pm Jul 16, 2002
Fetch API Request - Help!
I know more about it but I'm even more puzzled now!
9 Dreamquick 3:43 pm Jul 15, 2002
What is Indy library and can I get them to go away
12 korkus2000 2:37 pm Jul 14, 2002
New Wisenut Spider
7 fiestagirl 6:10 pm Jul 13, 2002
larbin (samualt9@bigfoot.com)
Anyone seen this before
5 fathom 6:17 am Jul 13, 2002
66.196.72.58
2 Visit_Thailand 1:57 am Jul 13, 2002
Inktomi Hosts
Any info on Inktomi identification?
2 cnegs44 9:06 am Jul 12, 2002
ipd/1.0
Has anyone else seen this one?
10 Pushycat 2:01 pm Jul 11, 2002
bad spider, no UA, no read of robots.txt
where's my newspaper....
6 dcheney 5:55 am Jul 11, 2002
bigip1a-snat.sv.av.com
who is from altavista ?
2 berno 7:32 pm Jul 10, 2002
Pioneer User Agent
3 frontpage 7:28 pm Jul 10, 2002
Internet Explore 5.x -
**mumble mumble** hyperactive chinese bot **mumble mumble**
6 Dreamquick 7:50 am Jul 10, 2002