Forum Moderators: open
1.The home page has been removed from the page totals and now appears as a sub-domain.
pages ***** Inlinks***** Subdomains (1)
now looking through some of the pages that are currently indexed I’m seeing more and more pages that have been removed and return a 404 server header. These are url only listings.
2.Of the pages that are indexed they are showing last crawled dates but no cache dates…but if I switch to my “subdoamin” the homepage shows a crawled date an a cache.
Slurps is still hitting the site as hard as it did before ratio of bot.txt views to other pages views is a fraction very few to the bot.txt file, many to other files.
So as far as I see I’m not suffering from Slurps not coming but, for some reason its not indexing the site correctly.
Any ideas why I should suddenly have a subdomain added to the site, when I’ve never had a subdoamin on this website.
I've had a site wide 301 redirect non - www. for many years now, so i don't see that being an issue.
Any input would be greatly appreciated.
Vimes.
2 of these have 301 redirects to no www (ie. just example.com). For both of these the index page is listed first in the full listing *as well* as as a subdomain.
The 2 that force www in the url (301) both have the main index listed *only* in the subdomain lists. (Not in the main list at all.)
Age of site doesn't seem a factor, without www 1 is 8 years old, the other 3, with www one is 9 years old the other is only 2 months.
The new site has had a 301 since it was first uploaded, 2 of them somewhere around a year or more and the 3 year old site has had a 301 for a few months.
The other difference is that I only submitted a sitemap.xml feed for the 2 that force the www. (I'll submit that to the other 2 without www's right now to see if it changes anything... ok, submitted, I'll report again if there's changes)
One of the ones with the www (the new one) has no links that I know of to it without the www and never has, the old one has quite a few (guessing around 30%).
As for the non www domains, both have quite a few linking with and without the www.
Slurp is crawling all normally, traffic.. it's hard to tell if it's been effected or not (Christmas traffic is up, I'll know after the Holidays are over more about normal traffic levels).
As for 404's having url only listings, I see a few on a site without the www.. some very old ones! I also see a few urls with the www on that one despite a 301 for a year.
(Wow, that's all confusing to read.. sorry, I don't know how to make it clearer :()
When I add the www I get a different crawl date (2006/12/05).. might have been before the 301?... and it lists a pile of www urls for that site. Many are old 404's, all but 2 are url only.
These might be url only since it's technically not a verified site with the www's?.. just a guess, I'm not submitting it with them to find out ;)
Interesting though, the new site that always had the www, and a 301... if I remove the www and search in Site Explorer, it goes url only, but *all* have the www. If I click the "Only this domain" link.. the url isn't found, and suggests that I submit it... I'm passing on that.
To me it feels like it's a 301 issue, but the new site may never have sent out a 301 to slurp since no links point to the alternate url and I use absolute linking in that site, always have.
Vimes.
