Forum Moderators: Robert Charlton & goodroi
Subsequently, the index page dropped out of the index completely and our website went down in listings badly as result, as only internal pages are still showing.
Of course, we removed the .htaccess immediately, but on yesterdays spidering Google hit us even worse and we are now showing on page 3-5.
Has anybody experienced this situation? Are we still on the way down or will we regain our old listings.
What needs to be done now to improve the situation, what can we do to find out where the problem really is?
- already done: reinclusion request
Maybe I was unclear. The website did not disappear, "only" the index page did (and completely, it is not a -30 or -950 penalty).
As all content flows from the index page, and subsequent pages have much less Pagerank, all other pages dropped quite a bit.
We assume it was a double content problem because with the wrong .htaccess 404-forwarding suddenly all 404 pages "looked" like the index page, and were indexed as such by Google (one can see one of them as identical copy of the index page in Google's cache).
This happened on the second round of Googlebot over those pages, after the .htaccess forwarding was already long fixed.
Therefore our question;
- has anybody experienced this before.
- how long does a re-inclusion request nrom ally take
- any other things we should do, eg somehow ask Google to drop the non-existent 404 pages (and how, as they are not really existing)
There might be another error reason, we also selected to display only links without www. in Google Webmaster Tools, but it seems the page with the highest pagerank for the months before was index.htm with www. -- never expecting they would not both be in the index or Google would substitute correspondingly after offering this tool and recommending so strongly to decide on one or the other.
What good are those tools if afterwards all rankings are messed up...
If this is part of the problem, we are assuming that index.htm without www. will be indexed shortly?
Any experiences on this or should we revert back to both www. and not?
While you wait for things to settle down and for your page to recover, take a look through some of the older threads here on protocol, domain, page, index, and query canonicalization (There are many, try a search [webmasterworld.com]). Also, consider the usefulness of having your home page called "/index.html", rather than the shorter and more-prevalent "/" (Question: Does google link to "www.google.com/index.html" or just "www.google.com/"?).
Also take the time to check normal and error responses from your server by using a server headers checker such as the "Live HTTP Headers" add-on for Firefox and Mozilla browsers, or one of the similar Web-based header checkers (Note that some of these latter do not display full headers, and in some cases omit intermediate redirects, so test carefully before trusting them).
A proper solution for 404-Not Found and 410-Gone conditions is to provide error pages which acknowledge the specific error (404=We goofed or you found a bad link on the Web, 410=We removed this page intentionally). On the error page, include text links to your home page, site map, and search facility as applicable. You may also include a meta-refresh in that page's HEAD section to forward the client to your home page, but I'd strongly suggest making the timer value long enough for the visitor to actually read and fully-consider the error message; A short meta-refresh is treated as a redirect by some search engines.
Jim
so there is neither a way of fixing it nor can we be sure that anything will improve and as one poster mentioned, Google works in weeks or months.
this feeling of total helplessness is the worst.