Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- How can I block strange URL's?


phranque - 5:30 pm on Nov 22, 2012 (gmt 0)


the Disallow in robots.txt matches urls left-to-right.


Thread source:: http://www.webmasterworld.com/robots_txt/4518731.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com