Msg#: 4356583 posted 1:17 pm on Aug 31, 2011 (gmt 0)
Thanks for the help. Not sure if you saw the two different robots.txt of XDA developers. I'm not sure how they are handling it. Anyway would like to know if with the one Robots.txt , am i at a disadvantage since the crawlers have to crawl lot many pages and there are ONLY couple of links on my wordpress page linking my forum.