Welcome to WebmasterWorld Guest from 54.224.200.104

Forum Moderated by: Ocean10000 & incrediBILL & keyplyr

Search Engine Spider and User Agent Identification


PreModerated forum to id search engine spiders

 
Thread SubjectMessagesStarted byLast Message
New Google IP?
5 msgraph 7:20 pm May 7, 2002
New FAST UA?
3 msgraph 6:55 pm May 6, 2002
Anyone heard of MOT 28 spider ?
Anyone heard of MOT 28 spider ?
3 xr2boy 4:57 pm May 6, 2002
What are inktomi's spiders?
2 korkus2000 3:46 pm May 6, 2002
Mercator?
What is this user agent?
6 przero2 3:26 pm May 6, 2002
icorus.com
No one seems to have written about this robot
4 misosoph 1:06 pm May 6, 2002
These guys scour without UA
3 littleman 2:49 am May 5, 2002
a few new ips and UAs
21 Crazy_Fool 11:35 pm May 4, 2002
Australian Academic and Research Network
2 wilderness 7:12 am May 4, 2002
Possible AOL spider detected
Looking for confirmation...
22 Key_Master 1:13 am May 4, 2002
Keynote Perspective software ?
hmm ?
1 zechariah 7:38 am May 3, 2002
any idea what spider this IP belongs to?
3 ferrari360 3:51 am May 3, 2002
fastsearch?
2 johnhamman 7:53 pm May 2, 2002
Up to date list?
2 Filipe 11:42 pm May 1, 2002
Inktomi
just added a new Class C
5 volatilegx 3:44 pm Apr 30, 2002
Need help with blocking this agent
4 willtell 5:41 pm Apr 29, 2002
Ng/1.0
belongs to Exalead
3 volatilegx 5:38 pm Apr 25, 2002
Microsoft
interesting
4 wilderness 5:14 am Apr 25, 2002
XO Communications?
Who are these folks?
12 Friday 4:50 pm Apr 24, 2002
AOL Spider
AC85944C.ipt.aol.com
5 Friday 8:02 am Apr 24, 2002
Is this a bot or a browser?
2 korkus2000 2:57 am Apr 23, 2002
RPT-HTTPClient/0.3-3
Nameprotect.com
7 wilderness 2:33 am Apr 23, 2002
Search Engine Domain Identification
Not Spider Listings but URL Referral Info
5 YadiYudi 2:11 am Apr 23, 2002
spidernet
help in defining this one
2 EliteWeb 6:29 pm Apr 22, 2002
Inktomi UA
was this out?
2 msgraph 1:00 am Apr 21, 2002