Page is a not externally linkable
- Hardware and OS Related Technologies
-- Linux, Unix, and *nix like Operating Systems
---- Server Change


powwow - 8:21 am on May 24, 2011 (gmt 0)


I don't think this is normal. If one crawler can visit all the pages, all the crawlers should be able to do the same providing that you don't block the access of the crawler from robots.txt.

You should ask your host for help on this, maybe they have some server wide settings that are causing this.


Thread source:: http://www.webmasterworld.com/linux/4316702.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com