Welcome to WebmasterWorld Guest from 54.145.246.183

Forum Moderated by: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification


PreModerated forum to id search engine spiders

 
Thread SubjectMessagesStarted byLast Message
Sidewinder is slithering (Go/Infoseek)
12 littleman 7:22 pm Oct 12, 2000
Boobook
6 littleman 8:13 pm Oct 9, 2000
Who are these?
7 Hope 1:10 pm Oct 9, 2000
New IP's Inktomi
1 Air 2:59 am Oct 6, 2000
What spider is this?
4 steven 10:20 pm Oct 5, 2000
Slurp fake?
4 rpking 7:53 am Oct 5, 2000
Scooter hitting submits.
4 pete 11:31 am Oct 4, 2000
Something Different?
Not sure what this.
3 drbill 3:16 am Sep 22, 2000
216.32.64.10 ?
5 mark roach 8:23 pm Sep 21, 2000
Brett's IP lists
maybe some corrections needed..
9 PeteU 4:36 am Sep 19, 2000
Strange Request from inktomi2-not.server.ntl.com
2 shri 7:03 am Sep 18, 2000
NEW Spider??
Anybody seen this guy before
3 drbill 1:16 am Sep 13, 2000
infoseek spiders?
2 roscoepico 9:04 pm Sep 11, 2000
AskJeeves Crawler?
Was I sleeping, and missed some topic on this? :)
3 redzone 2:11 pm Sep 8, 2000
1x1 pixel links on index page
8 knoxy 11:28 pm Sep 7, 2000
Help needed
7 adamcmoran 1:46 am Sep 7, 2000
Directhit is crawling hard.
Mozilla/4.06 [en] (Direct Hit Grabber)
11 littleman 7:25 pm Sep 6, 2000
Indeed it is
2 adamcmoran 2:51 pm Sep 6, 2000
Houston5
3 bluesriff 11:43 pm Sep 3, 2000
who owns this IP?
24.165.231.85
4 symmetry 6:10 pm Sep 1, 2000
AOL HTTP Requests w/ No User Agent?
Anyone else seeing this in their logs?
2 redzone 3:18 pm Aug 31, 2000
crawler0-complaints-to-admin.webresearch.pa-x.dec.c
Have I been sprung?
5 han chung 8:35 pm Aug 27, 2000
av?
7 roscoepico 7:31 am Aug 26, 2000
"Kite-Hourly" Intomi spider
??
3 grnidone 3:07 pm Aug 23, 2000
BEWARE... might be a sniffer....
5 Kamikaze 11:07 pm Aug 21, 2000

Featured Threads

My Threads

Hot Threads This Week

Hot Threads This Month