| noindex with .htaccess
|
mavi

msg:4083590 | 6:52 pm on Feb 19, 2010 (gmt 0) | Hi everybody Does anybody know a way to do noindex with .htaccess on an entire folder. The reason why i want to do that is that i have a mobile site which is structured exaclty like my actual "web"-site. ( just has a different css style sheet ) So when you come to the actual site through a link, it rediects you to the same link but with /mobile/ after the domain. What want to no now is avoid that the mobile site is indexed in SE. I know I could use <meta name="ROBOTS" content="NOINDEX,NOFOLLOW"> in every file, but I'd prefer a htaccess method. Thanx in advance Regards Martin
|
g1smd

msg:4083650 | 8:53 pm on Feb 19, 2010 (gmt 0) | It's easy in robots.txt, "Disallow: /folder" is all you need.
|
jdMorgan

msg:4083763 | 1:34 am on Feb 20, 2010 (gmt 0) | You can send the X-Robots header using mod_headers (if available on your server). Support among search engines is limited to the top-tier of search engines, though. See the Google Webmaster help pages (or do a search for the X-Robots HTTP header) for more information. Jim
|
|
|