Msg#: 4083588 posted 6:52 pm on Feb 19, 2010 (gmt 0)
Does anybody know a way to do noindex with .htaccess on an entire folder. The reason why i want to do that is that i have a mobile site which is structured exaclty like my actual "web"-site. ( just has a different css style sheet )
So when you come to the actual site through a link, it rediects you to the same link but with /mobile/ after the domain.
What want to no now is avoid that the mobile site is indexed in SE. I know I could use <meta name="ROBOTS" content="NOINDEX,NOFOLLOW"> in every file, but I'd prefer a htaccess method.
Msg#: 4083588 posted 1:34 am on Feb 20, 2010 (gmt 0)
You can send the X-Robots header using mod_headers (if available on your server). Support among search engines is limited to the top-tier of search engines, though. See the Google Webmaster help pages (or do a search for the X-Robots HTTP header) for more information.