Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- http:// and https:// - Robots.txt File


bilalseo - 6:20 pm on Nov 30, 2009 (gmt 0)


Thanks Guys.. the problem is fixed by adding two different robots.txt file... I have used one rotbos.txt file with allow option and other was used to tell sppiders to don't index pages with https:// .. this has also resolved with one robots.txt file .. but due to bothering... I just used two different rotbots.txt file to avoid bothering.. :)

Thanks Guys

Bilal


Thread source:: http://www.webmasterworld.com/robots_txt/4029215.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com