Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Bots ignoring my robots.txt


Nick_W - 12:12 pm on Nov 3, 2003 (gmt 0)


I think so yes. Check out the last couple of msgs here: [webmasterworld.com...]

Although I've not checked my logs in a few days, the last time I looked those pages were still beign picked up despite following Googles own advice..

Nick


Thread source:: http://www.webmasterworld.com/robots_txt/184.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com