homepage Welcome to WebmasterWorld Guest from 54.198.25.229
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
This? I've never seen this before..
BoneHeadicus

10+ Year Member



 
Msg#: 539 posted 7:35 pm on Apr 6, 2001 (gmt 0)

Just got spidered by:

Mozilla/2.0 (compatible; Ask Jeeves)

64.55.148.43

I know who it is but I didn't know they spider.

 

littleman

WebmasterWorld Senior Member littleman us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 539 posted 7:44 pm on Apr 6, 2001 (gmt 0)

Yeah they do crawl. You will also find one with a directhit label.

vis

10+ Year Member



 
Msg#: 539 posted 10:08 am on Apr 9, 2001 (gmt 0)

It's been doing a lot of Head, then Get recently, I don't understand, I've been such a good boy..

Has anyone figured out why Ask Jeeves sends out DH and AJ spiders. I can't think of any reason why AJ would send out spiders for the AJ portal so presumably they both input into the same DH database.

littleman

WebmasterWorld Senior Member littleman us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 539 posted 6:29 pm on Apr 9, 2001 (gmt 0)

Vis, I think it must be for branding -- to keep AJ in the minds of webmasters.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved