Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Google appears to be ignoring 301'd URLs


rowan194 - 6:50 pm on Aug 28, 2012 (gmt 0)


FWIW: I verified the IP only version of my site 2 weeks ago, but GWT is still reporting-

"We do not have enough information about your site at this time to allow changing the crawl rate. Please visit again later."

I don't know if this is again unique to my 200m+ page site, or there's a more generic reason they are not yet letting me change the crawl rate. (Googlebot has been crawling the IP of my site for, literally, years.)


Thread source:: http://www.webmasterworld.com/robots_txt/4484813.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com