Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Syntax for disallowing folder with '.' in the name?


g1smd - 9:57 pm on Jun 23, 2008 (gmt 0)


User-agent: *
Disallow: /compan

Put as much or as little of the /company.php/.... part into the Disallow statement as you like, enough to make it globally unique.


Thread source:: http://www.webmasterworld.com/robots_txt/3681885.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com