I have a folder containing cache files that I'd like my code to be able to access, but not the search engines.
I (PHP) include the cache file (E.g widgets.cache) if it is under 2 hours old from a folder called (root)"mycache".
However if I type in "http://www.mydomain.tld/mycache/widgets.cache" I can view the view.
Is there a way of stopping this from happening? Might not even by a .htaccess thing.
Many thanks