Welcome to WebmasterWorld Guest from 174.129.151.95

Forum Moderated by: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification


PreModerated forum to id search engine spiders

 
Thread SubjectMessagesStarted byLast Message
Aims Inc.,
X3@kto.takoy or (hhjhj@yahoo.com)
8 wilderness 3:00 am Jan 4, 2002
Spider from spyglass.com
Recieving multiple hits from 208.200.98.37
5 Feynman 9:35 pm Dec 30, 2001
crawler.tivra.com 207.140.168.143 tivraSpider/1.0
10 Brett_Tabke 7:13 pm Dec 29, 2001
Know this one?
3 agerhart 11:01 pm Dec 27, 2001
Anybody seen this one?
Mozilla/4.0 (compatible; Powermarks/3.5; Windows 95/98/2000/NT)
3 volatilegx 7:55 pm Dec 27, 2001
GAISbot
Who
5 lawman 5:51 pm Dec 27, 2001
[OT] Somewhat
determining what bots and etcetera to allow
2 wilderness 5:28 pm Dec 23, 2001
wordfreqbot 1.2 Who is this ? any ideas ?
h0050dac8c17b.ne.mediaone.net - wordfreqbot 1.2
9 diddlydazz 8:27 pm Dec 22, 2001
crawler0.archive.org
Noticed it for the first time
2 rjohara 7:53 pm Dec 22, 2001
ASPSeek/1.2.5 <--- I have done a site search but slider is mentioned
It shouldn't be in slider any ideas who it is??? IP 216.188.26.201
4 diddlydazz 12:20 pm Dec 21, 2001
tide.microsoft.com
anyone know more about this?
9 jdmerth 4:01 pm Dec 19, 2001
User Agent: Inktomi Search
New Inktomi spider?
3 Key_Master 12:44 am Dec 19, 2001
Persistent and nearly abusive
11 agerhart 11:01 am Dec 18, 2001
FAST Spiders...the new breed
2 Josk 1:50 pm Dec 17, 2001
addresses.com
www.addresses.com
3 wilderness 8:59 pm Dec 16, 2001
Webclipping.com
Spider Information, Experiences & Known IP's
6 Froggyman 6:11 pm Dec 16, 2001
New Excite IP's?
3 Son_House 1:13 am Dec 15, 2001
Need help classifying odd user agent.
3 Key_Master 2:38 am Dec 14, 2001
Who is Whizbang! Lab?
14 Gabriel 2:15 am Dec 14, 2001
Sitecheck.internetseer.com - spider all over me
What is it for?
3 backus 10:31 am Dec 12, 2001
10.200.30.38
5 Key_Master 4:51 am Dec 11, 2001
Interesting new visitor.
worth banning?
9 Woz 5:39 am Dec 10, 2001
What does this one do?
2 netcommr 7:05 pm Dec 9, 2001
A few new ones I haven't seen before...
Anyone know who they are?
4 SEO_Speedster 12:52 am Dec 9, 2001
WiseCrawler from Korea
5 rtennant 12:46 am Dec 9, 2001