Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- disallowing a variable


KevinC - 12:43 am on Nov 11, 2008 (gmt 0)


I think I found my answer but I'm little nervous pulling the trigger.

does this look correct:

User-agent: *
Disallow: /admin/
Disallow: /affiliatewiz/
Disallow: /eproducts/
Disallow: /themes/

User-agent: googlebot
User-agent: slurp
User-agent: msnbot
Disallow: /*EMAILFRIEND*


Thread source:: http://www.webmasterworld.com/robots_txt/3783670.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com