Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Link checker reports some exclusion

toplisek - 8:27 pm on Nov 9, 2011 (gmt 0)


I have seen on some links the following INFO warning:
Status: (N/A) Forbidden by robots.txt
The link was not checked due to robots exclusion rules. Check the link manually.

How is this related with robots files?
Is this issue:
<FilesMatch "\\.(js|css|html|htm|php|xml|shtml)$">
SetOutputFilter DEFLATE
</FilesMatch>

Thread source:: http://www.webmasterworld.com/robots_txt/4385347.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com