Forum Moderators: open
Normally the site grows at a tempo of 200 to 500 pages a month indexed by Google and others ... but since about 1-week I noticed that my site was loosing about
5,000 to 10,000 pages a week in the Google Index.
At first I simply presumed that this was the unpredictable Google flux, until yesterday, the main index-page from www.widget.com disappeared completely our of the Google index.
The index-page was always in the top-3 position for our main topics, aka keywords.
I tried all the techniques to find my index page, such as: allinurl:, site:, direct link etc ... etc, but the index page has simply vanished from the Google index
As a last resource I took a special chunk of text, which can only belong to my index-page: "company name own name town postcode" (which is a sentence of 9
words), from my index page and searched for this in Google.
My index page did not show up, but instead 2 other pages from other sites showed up as having the this information on their page.
Lets call them:
www.foo1.net and www.foo2.net
Wanting to know what my "company text" was doing on those pages I clicked on:
www.foo1.com/mykeyword/www-widget-com.html
(with mykeyword being my site's main topic)
The page could not load and the message:
"The page cannot be displayed"
was displayed in my browser window
Still wanting to know what was going on, I clicked " Cached" on the Google serps ... AND YES ... there was my index-page as fresh as it could be, updated only yesterday by Google himself (I have a daily date on the page).
Thinking that foo was using a 301 or 302 redirect, I used the "Check Headers Tool" from
webmasterworld only to get a code 200 for my index-page on this other site.
So, foo is using a Meta-redirect ... very fast I made a little robot in perl using LWP and adding a little code that would recognized any kind of redirect.
Fetched the page, but again got a code 200 with no redirects at all.
Thinking the site of foo was up again I tried again to load the page and foo's page with IE, netscape and Opera but always got:
"The page cannot be displayed"
Tried it a couple of times with the same result: LWP can fetch the page but browsers can not load any of the pages from foo's site.
Wanting to know more I typed in Google:
"site:www.foo1.com"
to get a huge load of pages listed, all constructed in the same way, such as:
www.foo1.com/some-important-keyword/www-some-good-site-com.html
Also I found some more of my own best ranking pages in this list and after checking the Google index all of those pages from my site has disappeared from the Google index.
None of all the pages found using "site:www.foo1.com" can be loaded with a browser but they can all be fetched with LWP and all of those pages are cached in their original form in the Google-Cache under the Cache-Link of foo
I have send an email to Google about this and am still waiting for a responds.
Quote:Question: Googleguy, If someone were to send you some examples, would you be willing to guarantee that the domains in question will not be penalized or banned, as long as the examples show only inadvertent (non-deliberate) hijacks?GoogleGuy: Sure, I'll promise that no spam-related action will be taken based on the reports. If months later, the domain comes up for review for an unrelated reason, then that's a different matter, but I'll instruct whoever collects the feedback to only use it to check out how we pick canonical pages.
There's no further comment from GoogleGuy about what this really means, but I think it's a very straightforward offer. There's enough noise on various forums about this now, including on this thread, that Google wanted current examples.
I get a sense that Yahoo, by attacking the problem first, has made it mandatory for Google to fix it too... and I think they're doing just that.
straightforward and I'd trust him. It takes 2 minutes to do so. Help them help us.
C
Are we having fun yet?
Regards,
R.
Has Google done anything to fix this bug?
Clint
I am in adult and could not use the examples I am aware of. If there are mainstream guys then it would be cool if they could send some research material to some finacial papers. I guess there are some assistants who would like to do some research if they get some starting help. ;)
I bet if we all put our resources together we could fund and build a search engine that put google and yahoo and msn to shame.
It wouldn't take long to recruit a few thousand webmasters that would love to help. I know I would. Then the webmasters who contribute would be share holders and own a piece of the company.
Then take the money and create a superior search engine that makes the rest look bad and it's money in the bank.
We could probably have it done in a year or less and making a profit by 2 years. When you have a superior product, it's easy to sell it.
For those that have their sites hi-jacked, take a new URL and Hi-jack the other site back and then cloak it with Google's IP address, so that only Google sees the hi-jack, but when visitors click on the listing they would see your actual site.
Just an idea...I don't know if it would work or not, but soemthing to try :)
Rest - I hope Google sort this soon. Sounds scary.
For $100.00 A press release can be released on PRWeb that will be picked up by Google News and Yahoo News.
I signed up for Google news alerts in the SEO category so I would love to see one come across my e-mail with a nice bold title - Google Misses Website Hijacking Exploit-Refuses to offer a solution.
What would really have worked is if we could use signature files in this forum Im sure this page could have been listed on Gooogles front pages as well.
Clint
