Random 404's on existing pages

[realmaverick]

Hey guys,

For the past few weeks, we've been experiencing random 404 errors from the homepage to other existing pages. The 404 errors are appearing for both visitors and search engines.

We run litespeed vs Apache, its up to date. Though I realise LS uses the majority of Apache settings.

When I checked webmaster tools, there are over 5,000 404 pages in the past few weeks, even though the page does exist.

A quick refresh of the page fixes the 404, but of course, many new comers won't know to do that and it just doesn't look good for any member to see a 404, especially when the content actually exists.

Most of the URL's are rewritten with htaccess and php.

The host have said it's not a server issue, I've contacted Litespeed and waiting to hear back but wondered if you guys had any advice for me in the meantime?

Many thanks

[jdMorgan]

> ... For the past few weeks ...

Examine the last-modified dates of all scripts on the server, and note those that changed in "the last few weeks." Inspect those for newly-introduced coding errors or database dependencies, and for hacks.

Jim

[realmaverick]

Thanks jdMorgan, we've checked the files, but cannot find anything wrong.

The host made several changes and also swapped our machine a few weeks ago due to another issue we had.

They claim the 404 isn't an issue caused by any miscofig etc. Though could it be?

A server misconfig seems much more likely to me, than a coding issue.

WMT has recorded 11,000 404's in the past few weeks. Which is scaring me somewhat.

[jdMorgan]

With a sudden onset of 11,000 404's, major changes to the server, no changes whatsoever to your site's code, and denial of responsibility by the host, I'd suggest that you try a new host.

If the server config is wrong, the most likely result is a hard failure, not intermittent failures. So this kind of problem usually points to scripting or database problems. But if you've ruled those out, then see the above.

Jim

[realmaverick]

Just a quick update. We actually found via the logs, that it wasn't just whole pages 404ing, but images and other stuff like favicons coming up as file not found, despite them actually existing.

Really confused why it's randomly not finding stuff.

[jdMorgan]

Files exist or they don't exist -- there's no in-between...

Start planning and preparing now to switch hosts -- back up your files and database to local media, set the time-to-live on your DNS to ten minutes. Identify a new hosting company, and collect all of the information needed by that new host to activate a new account.

Then call your hosting company, and tell them they have 24 hours to fix your server. After 23 hours, begin the new account set-up at the new host, leaving the "Submit" button un-clicked. As the clock ticks to 24 hours, click "Submit."

As soon as the server becomes available, upload your site, and switch your DNS. (If you have your DNS controlled by the old host, then that is also a problem to fix right now. Domain names and hosting should be kept separate.)

No use fooling around -- Like fish in the sea, there are many competent hosting companies competing for your business...

Jim