Forum Moderated by: open

Crawler, Spider, and User Agent ID


Forum to identify search engine spiders and user agents

 
Thread SubjectMessagesStarted byLast Message
Aranha?
Who, what, where and why?
3 makemetop 9:32 am Aug 20, 2000
AOL's Spiders?
They have been visiting my site for 1 week.
2 iambbq 6:56 am Aug 16, 2000
Oxxbot1, should I be happy, or worried?
Found this while wandering the web...
3 han solo 7:29 pm Aug 13, 2000
Is Big Brother Lurking?
Microsoft URL Control! I think they found me...
5 metaman 4:54 am Aug 12, 2000
New Engine?
5 scott 9:35 pm Aug 11, 2000
Infoseek
Are we having fun...yet?
2 Dumpy 4:17 pm Aug 10, 2000
inktomi1-car.server.ntl.com
8 stcrim 9:33 am Aug 10, 2000
AV spider
Do I want to know what this is?!
5 jilly 4:24 pm Aug 9, 2000
Snap Spider?
What is Snap calling their spider?
3 PaulTTC 12:30 pm Aug 9, 2000
207.230.106.188 DIIbot/1.1, www.findsame.com, robot@digital-
6 littleman 12:17 pm Aug 4, 2000

3 Hope 3:51 pm Aug 2, 2000
Who is this?
user*.ip3000.com
5 metaman 8:44 pm Jul 31, 2000
new spiders?
well - at least new to me
7 oilman 4:43 pm Jul 28, 2000
Keynote-Perspective
.... just another rubber frog
2 Air 11:17 pm Jul 27, 2000
is this a new inktomi spider ip?
8 funny 9:38 pm Jul 24, 2000
Who is this?
Are these SE spiders?
6 Dumpy 4:59 pm Jul 24, 2000
How do I use the Sim Spider tool
to see what spiders see?
4 grnidone 9:32 pm Jul 19, 2000
Why the concern over spider ip's?
what is done once the spider is identified?
4 spidercom 3:36 pm Jul 17, 2000
Any idea who this is...
2 stcrim 3:31 am Jul 17, 2000
TaWWWantula/2.1 ???
Anyone seeing this crawler?
6 redzone 2:12 am Jul 17, 2000
New Browser Tag?
8 NFFC 6:01 pm Jul 16, 2000
Fast Crawler
4 Kira 5:33 am Jul 15, 2000
SNAP.COM spider???
5 Kamikaze 3:31 pm Jul 9, 2000
Does AOL have any spiders?
3 Kamikaze 3:02 am Jul 8, 2000
Welcome to our new Moderator
4 Brett_Tabke 11:09 pm Jul 6, 2000