homepage Welcome to WebmasterWorld Guest from 54.167.173.250
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Visit PubCon.com
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
heads up! ghost.directhit.com
littleman




msg:408834
 10:05 pm on Aug 15, 2000 (gmt 0)

64.14.66.100 ghost.directhit.com Mozilla/2.0 (compatible; EZResult -- Internet Search Engine acurtis@directhit.com

 

mark roach




msg:408835
 8:10 am on Oct 11, 2000 (gmt 0)

This one just grabbed my robots.txt yesterday and nothing more. Any idea what its purpose is ?

Air




msg:408836
 1:49 pm on Oct 11, 2000 (gmt 0)

Thanx littleman, always appreciate those heads up.

shri




msg:408837
 5:28 am on Oct 20, 2000 (gmt 0)

same here. Got robots.txt and nothing else.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved