homepage Welcome to WebmasterWorld Guest from 54.196.24.103
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Subscribe and Support WebmasterWorld
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
Anyone have an answer for this one?
RealSpices




msg:401285
 2:55 pm on Dec 24, 1999 (gmt 0)

Looking through my logs the other day, I noticed a lot of useragents "EmailSiphon". So I did a little research and found out that these things are ####ing email addresses from my webpages. I would presume they're taking them from the forums as well as they tend to ignore any robot.txt.

Anybody found an easy to implement solution that won't mess with searchengine spiders? I may write something in PHP for when my whole site is done over, but till then is there anything out there?

Mike

 

fantomaster




msg:401286
 2:01 am on Dec 25, 1999 (gmt 0)

We have several pieces on just this topic on our site.
Have a look at:
[fantomaster.com...]

DaveAtIFG




msg:401287
 7:01 pm on Jan 17, 2000 (gmt 0)

You'll find some useful info here, too.
[csc.ncsu.edu...]

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
© Webmaster World 1996-2014 all rights reserved