Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Apache: execute "global" php script when robots.txt requested
g1smd - 6:46 pm on Aug 20, 2012 (gmt 0)Thread source:: http://www.webmasterworld.com/robots_txt/4486406.htm
You don't need a proxy. Rewrite requests for robots.txt to robots.php and the "include" the rest of the scripting from there. The included files can be abywhere within the server filesystem.
Brought to you by WebmasterWorld: http://www.webmasterworld.com