homepage Welcome to WebmasterWorld Guest from 54.196.189.229
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Subscribe to WebmasterWorld

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
How to identify search engine robots?
What's the best way for ASP developers to identify robots?
vieth




msg:1528859
 3:48 pm on Mar 23, 2004 (gmt 0)

What's the best way for ASP developers to identify visitors as search engine robots? ...by user agent? ...by host? ...by IP address? Is there an authoritative, respected list available somewhere? I'd like to be able to identify visitors that are search engine robots crawling my site so that I can supress the cart ID from appearing in the querystring. Any advice would be greatly appreciated. - John

 

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved