Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- how to ban Google from indexing ALL .php files


walkman - 9:07 pm on May 17, 2005 (gmt 0)


"12. How do I tell Googlebot not to crawl dynamically generated pages on my site?"
[google.com...]

User-agent: Googlebot
Disallow: /*?


Thread source:: http://www.webmasterworld.com/robots_txt/622.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com