Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Googlebot not respecting custom crawl rate


g1smd - 2:42 am on Jun 18, 2011 (gmt 0)


Use these two Google searches:
[site:www.example.com] and [site:example.com -inurl:www]
to see what's going on.

In particular, is the root homepage listed as the first entry?

If not, that's another indication of problems within the site.


Thread source:: http://www.webmasterworld.com/robots_txt/4325733.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com