homepage Welcome to WebmasterWorld Guest from 54.227.141.230
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Accredited PayPal World Seller

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
This? I've never seen this before..
BoneHeadicus




msg:401375
 7:35 pm on Apr 6, 2001 (gmt 0)

Just got spidered by:

Mozilla/2.0 (compatible; Ask Jeeves)

64.55.148.43

I know who it is but I didn't know they spider.

 

littleman




msg:401376
 7:44 pm on Apr 6, 2001 (gmt 0)

Yeah they do crawl. You will also find one with a directhit label.

vis




msg:401377
 10:08 am on Apr 9, 2001 (gmt 0)

It's been doing a lot of Head, then Get recently, I don't understand, I've been such a good boy..

Has anyone figured out why Ask Jeeves sends out DH and AJ spiders. I can't think of any reason why AJ would send out spiders for the AJ portal so presumably they both input into the same DH database.

littleman




msg:401378
 6:29 pm on Apr 9, 2001 (gmt 0)

Vis, I think it must be for branding -- to keep AJ in the minds of webmasters.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
© Webmaster World 1996-2014 all rights reserved