Forum Moderators: open
Normally the site grows at a tempo of 200 to 500 pages a month indexed by Google and others ... but since about 1-week I noticed that my site was loosing about
5,000 to 10,000 pages a week in the Google Index.
At first I simply presumed that this was the unpredictable Google flux, until yesterday, the main index-page from www.widget.com disappeared completely our of the Google index.
The index-page was always in the top-3 position for our main topics, aka keywords.
I tried all the techniques to find my index page, such as: allinurl:, site:, direct link etc ... etc, but the index page has simply vanished from the Google index
As a last resource I took a special chunk of text, which can only belong to my index-page: "company name own name town postcode" (which is a sentence of 9
words), from my index page and searched for this in Google.
My index page did not show up, but instead 2 other pages from other sites showed up as having the this information on their page.
Lets call them:
www.foo1.net and www.foo2.net
Wanting to know what my "company text" was doing on those pages I clicked on:
www.foo1.com/mykeyword/www-widget-com.html
(with mykeyword being my site's main topic)
The page could not load and the message:
"The page cannot be displayed"
was displayed in my browser window
Still wanting to know what was going on, I clicked " Cached" on the Google serps ... AND YES ... there was my index-page as fresh as it could be, updated only yesterday by Google himself (I have a daily date on the page).
Thinking that foo was using a 301 or 302 redirect, I used the "Check Headers Tool" from
webmasterworld only to get a code 200 for my index-page on this other site.
So, foo is using a Meta-redirect ... very fast I made a little robot in perl using LWP and adding a little code that would recognized any kind of redirect.
Fetched the page, but again got a code 200 with no redirects at all.
Thinking the site of foo was up again I tried again to load the page and foo's page with IE, netscape and Opera but always got:
"The page cannot be displayed"
Tried it a couple of times with the same result: LWP can fetch the page but browsers can not load any of the pages from foo's site.
Wanting to know more I typed in Google:
"site:www.foo1.com"
to get a huge load of pages listed, all constructed in the same way, such as:
www.foo1.com/some-important-keyword/www-some-good-site-com.html
Also I found some more of my own best ranking pages in this list and after checking the Google index all of those pages from my site has disappeared from the Google index.
None of all the pages found using "site:www.foo1.com" can be loaded with a browser but they can all be fetched with LWP and all of those pages are cached in their original form in the Google-Cache under the Cache-Link of foo
I have send an email to Google about this and am still waiting for a responds.
I had my .htaccess set up so that in case of 404, 403 errors etc the user would be directed to my index page instead of the default 'file not found' page.
I noticed recently when doing a site: check that pages I had removed were showing up, but with the title and snippet from my index page.
It seems google was taking the content on the index page as belonging to the non-existant file.
I changed my .htaccess so that a custom 404 page comes up.
I then went searching to see if any of my clients were affected and found one who had the home page hijacked. Their web link in Google is showing the dreaded URL only so it has affected the rank and this site hasn't grown much since I put it online and now I now why.
[edited by: ciml at 3:06 pm (utc) on Dec. 1, 2004]
[edit reason] Edited as per author request. [/edit]
I found another person using a tracker2.php code to hijack one of my pages. He has his own server, so I can't write his host, and his email from his domain data isn't working (of course).
Is there another way to find out who to report this to?
Lori
Good job, maybe that will get some results. I hope so.
Is there another way to find out who to report this to?
Yes, do a trace route and look for who is higher up in the food chain. He has got to have his server colocated somewhere -at his ISP's data-center, or at a telco colo facility.
Put them on notice, get them involved. It may take time, but it will work -in most cases.
This TRAVEL site seems to have really MASTERed this technique. Has anyone else noticed this?
groan!
On the other hand I suppose I should be flattered that he thought my page was good enough to hijack.
I wrote Google to report him. There must be thousands of webmasters affected by this guy so hopefully he will be dust soon.
64k results.
It would be nice to think that g were on to this crap.
The people who do this are lower than dog excrement.
This TRAVEL site seems to have really MASTERed this technique. Has anyone else noticed this?
Out of interest I just checked to see if they had us... they do. They don't seem to be having any affect on the serps though. If you find them with an allinurl, G shows 314 results, with 303 of them our pages, and the other 11 mostly that tracker2.php crap. But those hijacks are on the second to last page, about 300-310. Why does it affect some sites more than others? Our site has several PR6 pages, and the rest 5 and 4. 2+ yr old site.
All the same, I don't understand why G can't easily correct this and boot them. Their entire site is made up of hijacked pages.
I had GREAT success reporting one tracker2 hijacker (not the one mentioned above--this one sells music cds). I wrote to the hosting company, quoting their own TOS and pointing out the rules being broken by this hijacker, and included the hijacker's domain info and a copy of the bounced letter trying to contact the hijacker, and I received the following reply within 24 hours:
I have emailed the user. I have given him 24 hours to remove the information. If he does not, we will remove his account tomorrow at 12:30pm est, Nov. 18th. Please email me around 12:30pm tomorrow and let me know if your information has been removed.
PS. here is the reply I got from Google when I reported this hijacker in the spam abuse contact page:
Thank you for your note. Google aggregates and organizes information
published on the web; we don't control the content of these pages. In this
instance, we suggest that you directly address the webmaster of the page
in question. For more information about our Terms of Service, please visit
[google.com...]If you encounter sites that are trying to deceive our web crawlers, please
submit a report at [google.com...] We use
these reports to collect data that our engineers use to devise scalable
solutions to fight spam in our search results. While we do not always take
action on individual sites as a result of these reports, please be assured
that we are using the information to make large-scale improvements to our
system.We appreciate your assistance in maintaining the quality of our search
results.Regards,
The Google Team
Thanks to everyone for your tips on how to stop these hijackings.
Lori
I tried this and it works when I changed the url on my site so that the page the hijacker redirects to get's a 404 error page not found. Then I used google's url removal tool to remove the hijacker url. ssshhh don't tell google...
So if I had something that would automatically do that it would help a ton. just something that would give a 404 responce to anyone with "tracker2.php" in the referrer string would work.
That would prevent this from happening again.
Any ideas?
