Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Robots.txt for Query Strings


Yidaki - 6:08 pm on Oct 15, 2003 (gmt 0)


>does NOT stop G indexing index.php with any query string.

Hm... would mean that google expects to not getting crawled in such cases (since they disallow /mac?) but GBot himself DOES crawl such. Funny!

Thanks for testing, Nick!


Thread source:: http://www.webmasterworld.com/robots_txt/101.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com