Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Editing Robots.txt to block parameters
g1smd - 8:52 pm on Mar 4, 2011 (gmt 0)Thread source:: http://www.webmasterworld.com/robots_txt/4235296.htm
The rule is still potentially incomplete.
Disallow: /?lc=en does not block requests for
/index.php?lc=en for example.
That's another reason why
Disallow: /*?lc=en was suggested.
Brought to you by WebmasterWorld: http://www.webmasterworld.com