Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Site root page dropped from Google index

All other pages untouched.

         

bobbarnes

2:30 pm on Jan 8, 2007 (gmt 0)

10+ Year Member



I know there has been a lot of talk on here concerning missing http://www.example.com/index.html in UK search results but I've just been hit with this issue in all countries as of Saturday January 6th.

My small site has been indexed since April 06 and all bar one or two
pages have stayed out of the dreaded supplementals.

I have non-www redirecting to www and /index.html redirecting to / using .htaccess. No changes have been made to the /index.html since 18th Dec. Sitemaps shows no problems or errors and googlebot is crawling the site regularly. My other sites don't seem to have been affected.

The site ranked #2 in google search for the main two keywords which is the name of a European ski resort and the really frustrating thing is that January is the peak month for this sort of website. The timing is terrible and traffic has been hammered.

Any tips, suggestions, pointers would be greatly received. Even if it's only the number of a good therapist.

WiseWebDude

4:49 pm on Jan 8, 2007 (gmt 0)

10+ Year Member



Have you checked your homepage content for scrapers? Is your site STRONG (meaning NO hidden text on homepage, etc.)

On highly competitive terms, your competitors WILL try anything, so be like a ROCK and make sure they cannot penetrate you in any way.

:)

[edited by: tedster at 5:04 pm (utc) on Jan. 8, 2007]

bobbarnes

5:04 pm on Jan 8, 2007 (gmt 0)

10+ Year Member



Well I've done google searches using some quote bound 5-10 word phrases off my index.html page and haven't seen any other sites with the content. Is this what you mean?

I've put in a lot of effort to make the whole site google friedly. All hand written unique text ( nothing hidden ), validated html, unique meta tags. Generally all the stuff I've been reading on here over the last 6 months.

As you can see I haven't had cause to post before but I suppose all good things have to come to an end :(

I'm hoping its just a google index update glitch and that it may resurface in a few days ..

WiseWebDude

5:08 pm on Jan 8, 2007 (gmt 0)

10+ Year Member



Yes, that's one way, and there are other tools our there to check out if you've been copied. I hear Copy Scape is good (hope that is ok to post here).

But, you might be right and its a "glitch". I HAVE seen that as well. I saw one of my interior pages go completely out and then right back to #1...I guess they check them sometimes to make sure they were right on their previous assessment of that page.

WiseWebDude

5:20 pm on Jan 8, 2007 (gmt 0)

10+ Year Member



I checked out your site and looks perfect to me, clean, clear of spam, and no problems at all from what I can see (sorry again, Tedster).

Very well could just be a glitch on this one. I did a site:http://www.example.com/ search on your site, and you are right, your index does not show up (at least in first many results anyway).

I wouldn't worry too awful much since it has only been a day or so, I had same thing on different pages and then wham, it was back to #1 and has stayed there for YEARS...so I wouldn't get too concerned unless its been a week or two, etc...

Hope that helps, for what my opinion is worth :)

netmeg

5:59 pm on Jan 8, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I just had this same thing happen on a client's site - there's only ten pages, and last week I redid the design on all the pages; the same information is there, with the same page names, and all were ranked PR4, but it's arranged a little differently now. Google came through and spidered everything, and all the pages are there today except for the home page. I'm hoping it shows up in the next day or two.

bobbarnes

7:25 pm on Jan 8, 2007 (gmt 0)

10+ Year Member



WWW - Thanks, I'm keeping my fingers crossed that it'll be back in a few days.

Netmeg - your scenario is similar to mine. The last change I made to the site a couple of weeks ago was to finally get rid of the old image javascript navigation menu and replace with simple text controlled by a style sheet. So the change was made on every page with the same content.

webdude

8:21 pm on Jan 8, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



netmeg

Seeing the exact same thing here for our company page... gone. Trying to figure out what's going on. This site has been white hat since day one and everything is there except for the home page. nada...

netmeg

8:25 pm on Jan 8, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Well, given the vagaries of Google, I'm not going to panic for a few more days. Every time I look something up or do a site: command or do just about anything, I see something completely different than whatever I saw an hour ago. Either my glasses need a lube job, or else Google is all over whichaways at the moment.

Robert Charlton

8:38 pm on Jan 8, 2007 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



I've seen this happen intermittently to various pages over the past year. In almost all cases, I've been able to trace it to scraped content... generally a whole page duping us... and in all cases Google has figured it out and our original page has come back within a week or so. MSN hasn't always figured it out, and I've had to contact them.

On Google, I've observed that the problem can be query specific.

To check to see whether it's a duping problem, try adding "&filter=0" (without the quotes) to the end of the Google search url and see if this brings your page back.

To locate scrapers, try searching for unique 4, 5, or 6 word strings from your page enclosed in quotes... and try various searches, as some scrapers are breaking text up into pretty short strings. Generally, the scrapers are MFA (Made For AdSense) sites.

I'd appreciate comments from others who have been through the problem. Whether the engine figures it out or not, this is always worrisome, and it can cost a site real money.

webdude

12:48 pm on Jan 9, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Robert Charlton

I tried your suggestions and still nothing. I can't find the home page, nor any scraper sites. I tried searching various phrases and still nothing. What is really strange is that when I try copyscape by typing in either the domain (http://somesite.com) or the root page (http://somesite.com/index.html), it can't even find my home page. A different sub-domain pops up and it looks for duplicate content for that page. It won't even show my page. So then I got thinking... can anyone see the home page? I went to some of the free anonymyzing sites and it seems to display okay. Had some clients hit it as well. Using &filter=0 still does not display the page. nothing... nada. Just the home page. All the other pages are there. Doesn't show for a site: search neither. Does not show anything for cache either. This is something I have never seen before. Toolbar shows some green but I don't think that means anything.

Now I am starting to get worried. Did I do a booboo somehow? It is just a straight html page and has been in the serps for at least 8 years.

Any other suggestions out there? Could some competition have hurt the page somehow?

I just don't get it :-\

bobbarnes

2:28 pm on Jan 9, 2007 (gmt 0)

10+ Year Member



I'm finally seeing a recovery this morning. Been watching various datacentres and over the last few hours they've all started to pick up the /index.html. Sitemaps also shows it. The cache date is January 5th so I guess that in my case it was just an index re-jig as I didn't make any changes.

Interestingly, for my two main keywords in the UK I'm back at #2 but for the US I now seem to be #1.

webdude

2:40 pm on Jan 9, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Well... I just did a very in-depth look at what's going on with the home page and I am finding some very bizarre results. I have been searching on G and Yahoo for things like the title of the page, links to the site, etc. I have come to the conslusion that YES, your site can be hurt. I need some advice on how to fix this. It appears that our site has been googlebombed. I am not sure how someone did this, but I am finding links to our site in the most bizarre places.

We are listed in every yahoo directory out there for every country I can find. Japan, Singapore, Canada, India, Netherlands, Australia... you name it, we are there. What is wierd is that the word "programs" in the description for many of these is spelled "programmes." We are also listed for b2b housing (name your town) all over the place in Yahoo. Our site has nothing to do with housing, yet it is there. It appears in what Yahoo calls the local directory. Nothing I ever submitted. I am also finding our link in Yahoo's "What's New" pages. A bunch of them.

I found several references and links to our site in Wikpedia that I did not put there. It shows up on a page of a list of companies in a large metropolitian area. We are one of just 8 companies listed. It also shows up on what looks like nonsense pages. Things like "You ever laugh at a picture of a woman with a headset on? And then a list of sites with ours being one of them.

I have been finding our link in blogs hidden in the most strange ways. There will be a sentence with every word linked to a different website, ours being one of them. I have been finding our site linked in RSS feeds the same way.

You will find links to our site in the wierdest places, directories that are not even remotely related to our site. Drivings schools, wireless directories, hotel directories, etc.

I have found our text for our link in several places that actually lead to other sites. In other words, the link will be [somesite.com...] but the actual link will go to [someothersite.com....]

So... is there anything I can do about this? I have narrowed a lot of these links going up in mid-November. I think it may be the reason we totally disappeared lately.

Any thoughts?

tedster

5:23 pm on Jan 9, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I would report your findings to Google through a Webmaster Tools account.

webdude

5:54 pm on Jan 9, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



tedster

I am going to do that. I'll keep you informed...

webdude

7:54 pm on Jan 9, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



A couple of things...

I don't see exactly where you can email Google in the WebMaster tools unless you are trying to do a reinclusion request. It is very clear from the directions that to use this tool, you have faulted G in some way and now have cleaned it up and want to be reincluded. Well, the site is white hat all the way and I am not sure where you are talking about contacting Google with this problem

Second, I went into the google forum and saw a lot of people who have just their root page missing (cache, link, site, etc). Seems to be a lot more of this then just me. I searched around trying to find some sort of common denominator for this problem. One thing that struck me odd is a couple of the posts there had the root pages disappear to be replaced by a sub-domain. This is exactly what happened to me! I have a subdoamin that is now popping up first for my site. It seems to have replaced my homepage.

mysite.com - gone
demo.mysite.com - first for site: (used to be mysite.com)

Anway... just keeping you posted :-/

Robert Charlton

8:19 pm on Jan 9, 2007 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



...I have a subdoamin that is now popping up first for my site. It seems to have replaced my homepage.

mysite.com - gone
demo.mysite.com - first for site: (used to be mysite.com)

webdude - Grasping at straws here... Was your DNS by any chance set up with wildcard subdomains, to handle typos in the "www" part?

webdude

8:40 pm on Jan 9, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



No. I do not use wildcards. I handle my own DNS. I have several subdomains all pointed to different IPs. Nothing really complicated.

Webmastertools shows the last crawl at Demember 7. I find that odd. Sitemap accessed 17 hours ago and showing okay. Everything looks normal. No errors, no nothing. All of my other sites have been unaffected. No other pages have been affected, just the home page for our company site...

mmmm.... :-/

vinove

3:06 pm on Jan 10, 2007 (gmt 0)

10+ Year Member



Add another vote here.

One of my website's home page taken off the index - so many of my rankings have gone away!

I hope this is a short term glitch as my website was, for sure, not over-optimized!

webdude

3:14 pm on Jan 10, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Okay, the home page is back to its original position = #2 for my money phrase. It shows retrieved on 9 Jan 2007 04:15:09 GMT for the cache. I did not contact Google in any way. It must have been a glitch. In fact, it seems my searches have reverted back to what the SERPs looked like last week. In fact, many of the datacenters had my homepage gone yesterday and now almost all but few show it back to its original position... go figure. A little shuffling perhaps?

WiseWebDude

3:23 pm on Jan 10, 2007 (gmt 0)

10+ Year Member



Exactly, I think they do do some type of "is this site the real deal" testing for sites with high rankings anymore, I have been through the same thing.

It is quite alarming when it happens, but be patient!

netmeg

3:24 pm on Jan 10, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Yea, the one client site where I was missing the home page is back today too.

Unfortunately, another site of mine (personal) has suddenly completely vanished from the index, except for the plain text sitemap page. Webmaster doesn't report anything and says it's in the index (but I don't think they're updating that very often these days - I've had the same exact query stats on ALL my sites for weeks now, and some of those terms were holiday-driven and certainly wouldn't be current now)

Again, trying not to panic for a few days...

(Serenity NOW!)

vinove

3:31 pm on Jan 10, 2007 (gmt 0)

10+ Year Member



Easier said than done - specifically being patient :(

*biting nails in anxiety*

WiseWebDude

3:49 pm on Jan 10, 2007 (gmt 0)

10+ Year Member



True, it is very hard to be patient in those situations. Admittedly, I was not in a state of peaceful bliss at the time I experienced it as well.

We need a Webmasters in Distress - Support Group Forum in here, eh?

:)

bobbarnes

4:58 pm on Jan 10, 2007 (gmt 0)

10+ Year Member



Yes I agree, very difficult. I was really flapping 2 days a go. I think it's that feeling of not being in control, when it's near impossible to contact google and just not knowing whether it's your own fault / someone else's doing / or an index glitch.

They say knowledge is power. It's also very good for stress levels.

Anyway, two sites of mine are seeing changes today. One, 2 years old that has had pages removed / gone supplemental. Another new site with pages coming in. So this time I'm going to ignore the situation for a few days and concentrate on other matters. Then I'll panic.

miketheinternetguy

5:09 pm on Jan 12, 2007 (gmt 0)

10+ Year Member



add another homepage missing and rankings gone for me! This happened on the 10th or so. Still waiting.

Webmaster Central is telling me Google last accessed my site Oct 15 2006! However I run ClickTracks and Googlebot is visiting at least the homepage daily .Any more ideas, or should I just have patience?

netmeg

5:22 pm on Jan 12, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I dunno; something is weird. I had a site that disappeared - ranked #1 for its primary search terms. Three days ago, all 7 pages disappeared. The next day, one page was back (a plaintext sitemap file). That night, there were four pages, but three were supplemental. Yesterday there were two non-supps - the sitemap and the search page. Today there are three non-supps. No ranking whatsoever, and all Google traffic has completely gone for the past three days. That site was just starting to take off, too. So it's adding back a page a day, but why only that? And where's the home page? I'm confused and disoriented. Appears to be happening just to the one site, too.

miketheinternetguy

10:56 pm on Jan 12, 2007 (gmt 0)

10+ Year Member



netmeg,
Same here. When I noticed the traffic drop, I checked and 2 pages were indexed. The next day 4 pages were indexed. That has been for 2 days and the homepage is not one of them. Also the date for crawling in Webmaster Central is totally off by 3 months almost!

miketheinternetguy

12:21 am on Jan 13, 2007 (gmt 0)

10+ Year Member



My site just got indexed again and all pages are back. The rankings are even improved! Just have patience as I almost crapped my pants for no reason