Forum Moderators: Robert Charlton & goodroi
There is no cache of my site.
Any ideas as to what the hell could be going on?
At a loss,
Wildegray
Newbie here. Why is robots.txt the entire sire a bad thing? At least that's what I get from your post.
Only my second post here, but I've been reading for awhile, and have been learning alot - thanks.
I haven't been able to find an answer to this question anywhere yet - so maybe someone could lend advice or opinion. I have had pages in supplementals for over a year, and recently - when I click on the cache button - Google doesn't have the cached page anymore. Could this mean they are finally getting dropped from supplemental index & might be available to be recrawled & added to main index? Also, some of my "non supplemental" pages have recently disappeared (even though my page rank has gone up recently).
Thank you!
Thank you for your reply. You were right. Some of those pages have been deindexed since my first post.
Since the pages were all supplemental (for over a year) I am wondering if this is a good thing - maybe they will now be eligible to be crawled & included in the main index.
Also, I lost most of my non-supplemental, but they did not go the no cache route. From reading, I think this might be part of the Big Daddy process.
Any thoughts? How long have you been deindexed for & Have you been successful in getting any of your pages reindexed.
Thank you so much!
My homepage, for example, hasn't been indexed since February (I think I just bit through my tongue as I typed that), but other pages (such as my resource page, or pages with contextual links to other pages or sites, are getting indexed more frequently (in some cases, four days ago).
I have global navigation on every page, so I can't see how (or why) the spider would just ignore certain pages (though, as I said, the pages with more contextual or outbound links are getting crawled more) unless that's a new parameter of the Googlebot (or maybe I'm getting indexed by the Adwords bot, and it's slacking on the job?).
Additionally, I have plenty of inbound links to my homepage via my own server, and literally dozens from other IPs and legit sites.
Any takers? Common threads?
The one common denominator is that the pages in question are in sub-directories, though not all pages in sub-directories are affected this way - but a lot are. It seems it's more so in lower PR sites and where the particular pages aren't well linked-to within the site.
Anyone seeing anything similar, or differences between pages in sub-directories or ones at root level?
