Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Block specific part of the site
mseo - 3:42 pm on Nov 23, 2010 (gmt 0)Thread source:: http://www.webmasterworld.com/robots_txt/4234068.htm
I was wondering if any of you guys know how to use robots.txt file to block acces to a specific portion of a site;
We have about 40 subdomains and same ammount of language id's.
Brought to you by WebmasterWorld: http://www.webmasterworld.com