|My peers are having the same thing happen to them, we actually have started talking to each other to try to address it. |
There is only one way - take the fight offline. If there were doing this to my store front I'd be round their house with a baseball bat. No rules saying that you have to keep the war they are raging online, online. Right now I'm finding out the home addresses of all the directors of big company name 1, big company name 2 and big company name 3 and sorting out some alibis for myself ... ;)
The anonimity of the web has given cowards a way to seem brave. I'm sure 5ubliminal wouldn't be spouting "I'm a blackhat and I see this totally different. Sorry:)" so cheerfully if we were having this discussion in one big room ...
|My peers are having the same thing happen to them |
Google needs to put into place a top notch "rapid response team" of engineers to work with people like you to get this stopped before it becomes common practice across the web.
I was very suprised that my only recourse was to notify them via the security exploit team and the unhappy with search results section.
It is obviously a exploit and it is being used by some of the biggest companies on the web, they go out there and buy a trusted property and then engage in this new tactic to take out competitors using that property, im not talking a few pages here, im talking millions of pages.
All I have to say is hope or even pray they dont target you because you will have to watch your 4,5,6 or 8 year old matured well ranked pages get destroyed over night one by one for weeks on end.
Between this and some other stuff Im about to throw in the towel after 10 years.
Build great content - 40,000 hours
Get respect via gazillions of natural links - 5000 hours
Update frequently - 10,000 hours
Make sites for users - 20,000 hours
Dont bend the rules - 30,000 hours
Your pages being targeted getting destroyed overnight - PRICELESS
|I do site: searches for websites that appear to have indexing challenges. There is one thing in common amongst all of them, they have a high number of scraped entries being indexed. Its almost as if someone purposely made sure that this particular site appeared in every "bad neighborhood" they could find. From MFA's to Arbitrage sites, they were everywhere. They were also included in hundreds of directories, blogs, social media sites. I'm tellin' ya, that whole network of scraper sites is damaging to one's Internet presence. I don't care what the search engines say, there is cause and effect taking place. |
It was bad enough to begin with but in the past 48 hours I've been hit with a business running 500 scrapers to my site with cloaks, redirects, everything. Their pages are being added hourly as I watch posted 1 hour ago, posted 2 hours ago etc. etc. I'm proactive but you can't keep up with all the garbage Google is dredging up now. You're a hop, skip, and a jump from vanishing completely in Google without a response from them. Meanwhile Google is thinking up every filter, penalty, and reason to toss you in the supplemental results.
Meanwhile year after year I sit untouched in Yahoo and MSN plus dozens of other engines. Google didn't run a very good search engine to begin with and Universal search pretty well ended any future hopes of it. Google has just become one incredible pain and workload to everybody except for the ordained it doesn't touch.
maherphil - "I'm convinced that there is NOTHING that can be done to a competitors site "
Tara - "I do not agree with your first point. Inbound links from bad neighborhoods cannot hurt you."
bouncybunny - "1. Inbound links from "bad" places. Does this really attract a penalty?"
Your sites are obviously not targets yet. Anyone with a high ranking site in a competitive industry will have been the victim of SEO Vandalism. (Let's stop calling it black-hat as it does not fit into that camp, it is criminal acts, not keyword stuffing alt tags ...)
I wish someone had shown me this stuff as I was building my rankings, so if you would like to send me your website addresses that are ranking the best I can destroy those rankings for you. Better to learn now rather than later. Feel free to sticky me with the details, I can destroy them for as little as $100 - a cheap lesson now or an expensive one later.
It seems to me that if I send in a spam report it is just ignored. The reason for this, I suspect is because they get millions of spam reports and can't possibly deal with each one. Also what seems like an enormous problem in a small back stream of the Internet like the UK is very, very minor in the US. Google needs to find a way of filtering the millions it receives to find the ones that are worth individual attention.
In the UK, in certain regulated industries, there is an independent complaints service called an ombudsman service. If a member of the public has a complaint which cannot be resolved through a normal complaints procedure then they can take their complaint to the independent ombudsman. If their complaint is one for which the ombudsman service thinks it has juristiction the company being complained about has to pay a fee, around $1,000 and has to accept the findings of the ombudsman.
This whole process is designed to stop frivolous complaints being escalated and it seems to me that Google could implement a similar system to help it identify the really serious issues.
If they had a team of engineers that you could refer an attack to along with a significant fee (this could be a deposit which would be returned if it turned out that you were correct) then Google could deal with individual problems and use what it learns from them to improve the overall situation.
If they don't do something to provide a method of resolution I think that eventually they will either be forced to do so by regulation or they will fail under a storm of spam, like Altavista.
8 years / dedicated / pr7 / ecommerce
If only each of these posts were prefaced by each owners website stats (age of site, hosting, PR#, type of site, etc) I believe we would see different trends amongst different groups of people.
At some point all of our generalization and speculation is a waste of life without further data to compare. It's not a 1 suit fits all algo, geez even the og alta vista was more sophisticated than that. Some of you need to remove the tinfoil, go outside, and ride a bike or something.
I'd love to but the ABS on my R1150RT needs fixing.
9 years /PR3/ UK niche
Google does allow other webmasters to damage your serps.
I started a thread here [webmasterworld.com...] and then found your thread.
Take a look, I and probably many others could do with some quality advice.
I think Google is smart enough to identify links from a forum/blogs and links bought from a link farm.
Let's assume that the traffic drop is not harmful activity by other webmasters, but rather a result of Google Update.
how long will it take untill things settle down in all datacenters?
Slow it way down. Is there a "sure" way to tell if your site is indeed affected by this exploit or if your drops are just a function o G's ever changing algo?
9yrs/was 5 now 4/US reseller
Ok, so my question is, if it's the G's algo change.
When do we expect things to settle down? I mean now things are still fluctuating right?
|I think Google is smart enough to identify links from a forum/blogs and links bought from a link farm. |
Ummm .... of course they are. What was your point? Our problem is that they are penalising things instead of just igoring them which gives dodgy competitors a way to vandalise our sites.
|Let's assume that the traffic drop is not harmful activity by other webmasters, but rather a result of Google Update. |
We're not talking about traffic drops that we can't explain. We're talking about our competitors that have used tactics to have us either dropped in ranking or completely removed from the index. This a very specific thread about very specific activities that are going on. You're looking for the threads that say "I have a 1 million page review site that I bought for $49 and 95% of my traffic has suddenly disappeared overnight"
Please read through the thread, we are talking about competitors hijacking, buying bad links, duplicating content, installing malware etc. etc. deliberately to attack our rankings. Not unexplained traffic losses.
Please note: I'm sure I'm not the only one being stickied alot over this thread. Please stop asking for details on the exact tactics used because I don't know you or your ethics. There is a reason people are being vague in this thread on exactly what to watch out for.
|We're talking about our competitors that have used tactics to have us either dropped in ranking or completely removed from the index. |
Exactly -- this is apparently no random fluke. We have members right here who could explain this intentional exploit in a highly defined step-by-step manner -- drall stopped just short of doing that in post #: 3623934 ("I will not elaborate beyond the following ... The exploit is being used by large inhouse corporate seo teams...").
That tells me that Google engineers could get to the heart of the problem very quickly if a G rep were to step into this discussion and contact someone like drall directly for the details. They need to do that now before this sort of thing gets too big to handle, or, can only be managed with draconian measures.
Assuming this whole "Google allowing other webmasters to damage your site" phenomenon is actually happening, I think one aspect of the problem has an obvious fix: Google should change the algorithm so that "bad" sites can't corrupt the relevancy of good ones merely by linking to them. The site-scraping issue? That's another matter (assuming that Google isn't able to accurately determine which version of the copied material existed first), but at least the inbound-bad-link issue should be comparatively easy to change.
[edited by: jatar_k at 7:17 pm (utc) on April 11, 2008]
What I would like to know is:
How new is all this, particularly the tactics, which you, drall, explained?
Could you estimate a minimum daily uniques or pagerank this tactic targets? Or does it affect any type of site?
7 years / dedicated / pr4 / B&M(niche)
From what me and my competitors have figured out it started around mid December, we couldnt figure out exactly what was going on until February-Mid March. Yes it is that advanced.
As far as Pagerank is concerned it makes no difference what the pagerank of the page they target is nor does it make any difference on how popular the page is. The exploit they are performing bypasses everything that is fundamental, similar to the proxy hijack issue but substantially more powerful.
The first and last thing you will ever see if you are the target of this is when you view a cached page of your page and it will show another website, yes you heard me right, another website has replaced your cache because Googlebot is being tricked in an entirely new way, not the old proxy hijack way which is trivial compared to this.
After spending hundreds of hours backtracking we found the culprit and we figured out how they were doing it.
The inhouse teams of the large corporate publicly traded company that is doing this has done the research. They know exactly what to target on our site and others and once they do, well bahbye Google traffic.
There is no defense to this, it is purely a Google problem as our top security and technical guys have stated and the very exclusive club that knows about it is using it with great effect cutting wide swaths of quality content out of the competition.
So spending 1-2million to wipe out millions of your competitors pages was worth it to them. Im am also quite sure upper management is keenly aware of this within the company thats doing it, this was a well planned and well funded project.
As far as other areas I do not know what the penetration is but in our area of the web which is technical in nature my last count was 28 of our competitors have been effected by this.
Sadly all of our tests have failed to bring back the effected pages, googlebot is being tricked via the redirect chains and your page is gone forever it seems once this happens.
Im quite sure Google is aware of it, perhaps someday they will workout a solution since they usually do things on scale but this may take some time. I honestly do not blame Google for this, it is not Googles fault that someone has figured out a hole, I just hope they plug it soon.
I will say this, I havent seen it used outside of my industry segment yet....
I certainly agree with you that Google should not be blamed because some very smart and unscrupulous people have figured out how to exploit their service. However I note that you're quite certain that they are aware of the situation, therefore I think it's fair to say that it's their responsibility to demand of their engineers a total committment to solving the problem ASAP -- anything less is inadequate under the circumstances.
It's like have a bomb loose in the community -- it's not law enforcement's fault that it's there, but now that they know about it, every officer should be out looking.
If this thing is as bad as you say, then the lights at the Plex should be burning 24/7.
|Hundreds of links from one IP address. |
Again, is there a penalty here?
Might it look like you just bought a bunch of links?
I have been so naive until recently about how widespread link buying has become. I am beginning to see the light now. It appears to me that any new business (and probably old ones as well) assume that buying links is a necessity just as back in the old days we knew that we needed to get links based on the content on our site .
If Google is trying to fight link buying they will look at patterns that might indicate a site is buying links. Google can't look at every site on the net so they have to find trends or patterns. Thus they no longer ignore inbound links.
I think that this thread is in fact several threads that have become intertwined. Could I suggest someone starts a thread on the proxy grab issue and someone else on the 301 issue and someone else on backlinks from bad areas so that we can all make sense of it.
Proxy urls are actively being discussed in this thread:
|I think that this thread is in fact several threads that have become intertwined. |
The thread didn't start as a discussion of the exact tactics and how to identify them. It was supposed to be a discussion on why Google chooses to allow webmasters to vandalise each other's rankings whilst other search engines do not.
Google can't be that daft, which leads me to believe that as they are aware of blackhat SEO and are aware that they are allowing webmasters to wage war on each other that they are actively encouraging this war?
Analagy Attempt: if a government were to leave a stockpile of guns and bombs in the middle of an ongoing warzone between two sides knowing that only one side would happily pick up those guns and kill the other side.
With regard to links from bad sites.
FWIW I think that Google has simply made a huge mistake allowing an algorithm to apply penalties. Once it has been spotted what causes a particular penalty to be applied it is easily reproduced. Now if you get a dodgy third party in a remote and scary part of the World to do the dirty deed on your behalf then it is virtually impossible to trace it back to the perpetrator and what is worse it is virtually impossible for the victim to escape from being continually shafted, even if they know it is happening.
In the last few days my website started to dissapper from Google index. The only thing which happend during those days is that my forum was "attacked" by spammers - a few hundred posts with spammy links, mostly adult.
Does Google penalizes websites because of external links pointing to adult content or what?
p.s. The links are not marked as "nofollow".
[edited by: tedster at 3:19 pm (utc) on April 18, 2008]
[edit reason] moved from another location [/edit]
|Does Google penalizes websites because of external links pointing to adult content or what? |
Yes they do, webmaster guidelines for Google state who you link to is noted. And many are moving toward the feeling that Google have not been 100% upfront about the nofollow tag anyway so I doubt it would make any difference.
We had this on one of our review sites. Just add some coding that disallows the submission of HTML tags or that brings up an error if regular "adult" terms are used. Most of these submissions are automated so returning an error when HTML tags or adult terms are used rather than just stripping them out is the best way.
|And many are moving toward the feeling that Google have not been 100% upfront about the nofollow tag anyway so I doubt it would make any difference. |
Although it is possible that there are certain exploits that can be used to damage others rankings, those must be limited to complex cases and exclusive ($$$) attackers. It is reasonable to assume that nearly all simple stuff that does not require a lot of research and investment has already been tried and fixed.
There is NO chance that such a trivial attack as placing a link from a bad neighborhood can do any damage. If it worked, everyone would be doing this, and SERPS would be a total mess. The real situation, however, is that I see that many blackhats are doing that indeed, but to no avail. My site, and any other site holding 1st position in Google for moderately competitive niche, has a considerable amount of links from adult, gambling and other junk sites, and my content is being scraped every day even before it is indexed by Google. It doesn't change much really.
I feel like this thread is a little bit paranoid. I must admit though that drall's posts made me nervous too. There is one thing we still can do - diversify. You can not be hit in all markets at the same time ...
|And many are moving toward the feeling that Google have not been 100% upfront about the nofollow tag anyway so I doubt it would make any difference. |
If there were evidence of anything Google did in regards to ranking I'd be surprised! This "concept" comes from the "fact" that links with nofollow are showing up in backlink reports, links pages with nofollow attributes are being dropped from the index, pages using nofollow for internal linking to stop link juice loss seem to be losing ranking and such like.
|must be limited to complex cases and exclusive ($$$) attackers. |
Not really. It doesn't cost much to do in most instances, I think I already quoted in this thread that I could knock out a large majority of sites for just $100. To hang on to my ethics I'm willing to spend $1000 on better links and some new content than $100 to attack my competitors ...
|If it worked, everyone would be doing this |
There is only one person in this whole thread that has stated they do this sort of thing. The rest of us know about it and are disgusted. I know a huge amount of black hat tactics as do most of the webmasters on these boards and we refuse to employ those tactics whether they work or not. Are you saying that if you knew how to vandalise someone else's hard ranking work and quality website you would do so?
|Are you saying that if you knew how to vandalise someone else's hard ranking work and quality website you would do so? |
No. But the number of people doing that would be large enough to turn Google SERPS into the total crap, and leave Google no other choice but to fix it.
|This "concept" comes from the "fact" that links with nofollow are showing up in backlink reports, links pages with nofollow attributes are being dropped from the index, pages using nofollow for internal linking to stop link juice loss seem to be losing ranking and such like. |
Ok, interesting. I was not aware of that. But I am still saying no evidence. Just a speculation. We all know huge forums that have tons of nofollow links, and they are far from being dropped from the index. On the contrary, they have hundreds of thousands pages listed and growing.
|I think I already quoted in this thread that I could knock out a large majority of sites for just $100. |
Guys, this thread makes me feel incompetent :-) It looks like knocking out a competitor is a common knowledge here. Is it only me who has no f#$%$ing idea how to do that? (no pm offers, please. I am ok with my ignorance)
But you know what? If you guys know how to do that, please do a favor to the web community. Knock out techcrunches, expedias, wikipedias, facebooks, apples, etc. My guess is that after you do that, it won't take long before Google takes action to eliminate the loopholes. Everyone will be back to his natural rankings and happy :-)
|please do a favor to the web community. Knock out techcrunches, expedias, wikipedias, facebooks, apples, etc. |
Ah, you're forgetting - Google can make manual fixes behind closed doors for individual sites (its 11pm so hopefully someone else will point out some examples over the years). Even if someone did spend the money and time it would take to do damage to such big brand names Google could simply flip a switch from behind the curtain. If you spend hundreds of thousands on Adwords then your rankings are pretty secure as you'll have the Goog Tech Team on the case within the hour.
| This 123 message thread spans 5 pages: < < 123 ( 1 2  4 5 ) > > |