My site hit 27 November - Google Update?

[Mentat]

Here is the drop of one of my subdomain since 27 November.

[i.imgur.com...]

Site since 2002, no link building, but a lot of bots are scrapping my site :(
A lot of sites are using my RSS to create content.

Other subdomains got hit on 4th of September.
One is back, the only one left alone (no content cleaning, only links disavowed).

So the question still remains... what is this?
Panda, Penguin or a nasty bird?

[itsjustme2]

I had a manual penalty on one product page.
I searched and searched and I found a lot of .ru domains linking.
The problem was that the site is huge and I have a tens of thousands pages! It's a needle in a haystack, so I've removed the page 410 gone error.

I give up! :@


btw, that to do with *.blogspot.com/ru/fr/br/etc domains?
The same blog has automaticly/infinite TLDs! :@

I don't think you can disallow for
domain:.ru

on the disallow text,

but you can filter for .ru on the spreadsheet
copy and paste the results to a separate spreadsheet to eyeball the results

I've been going through the same thing...

it's easier to combine the spreadsheets from WMT and other of the backlink checkers, then filter on the domains column to eliminate duplicates

i.e., using different backlink checkers will automatically produce some domain duplicates.

The problem is that checking backlinks and checking domains on a site with thousands or tens of thousands or hundreds of thousands of links is a very difficult technical task when you are sifting through both domains and urls.

here's how the Rap Genius recovery story was reported.

Following the detailed mea culpa the founders included a list of four steps the search engine required they take in order to receive forgiveness:

Download a list of links to your site from Webmaster Tools.
Check this list for any links that violate our guidelines on linking.
For any links that violate our guidelines, contact the webmaster of that site and ask that they either remove the links or prevent them from passing PageRank, such as by adding a rel="nofollow" attribute.
Use the Disavow links tool in Webmaster Tools to disavow any links you were unable to get removed.
It turns out there were 178,000 suspect URLs, but with 100 workers scraping URLs the task was completed in 15 minutes, according to the post.

If you have 100 technical employees you might be ok...otherwise, try to go as systematically as possible through all the links and domains to determine which ones or groups of links can be disallowed.

[DansSitesRScrewed]

The tool on webmasterworld where you can upload your links and it separates and controls them, removed duplicates and makes it very easy to manually check the links and create a disavow file. Watch the videos how it works, it's really nice.

[itsjustme2]

The tool on webmasterworld where you can upload your links and it separates and controls them, removed duplicates and makes it very easy to manually check the links and create a disavow file. Watch the videos how it works, it's really nice.

agree, Boykin does a good job with the tool, automatically filtering, whereas I manually filtered, copied, pasted and eyeballed different domains...

He also mentions that the sweat equity associated with the tool comes with the actual eyeballing and interpreting the "value" of the links, once they are sorted with the tool.

It literally takes hours.

Also note, he mentions the need to look for more backlinks other than the WMT backlins because WMT only provides a subset of total links.

[dethfire]

Some of us don't have 100 works working 8 hours a day to review 178k links. I've been seriously hurt by spammers. I have disavowed about 500 domains, but I'm sure that isn't all.

[itsjustme2]

Some of us don't have 100 works working 8 hours a day to review 178k links. I've been seriously hurt by spammers. I have disavowed about 500 domains, but I'm sure that isn't all.

it's called irony

if you buy links and get caught, it takes about ten days to recover

if you don't buy links and get caught up in the scrappers and negative seo, it takes about ten years to recover

I'm at disavowing 1500 domains of scrappers at present....if I knew what to do, I would have done it two years ago...

it's the antinomies of big data

[Mentat]

I've just found a tons of subdomains on sourceforge.net with pr0n content and links to me :@

This is crazy!

[Planet13]

@ Mentat

I am sorry if this is a stupid question, but i have to ask:


when you had that big drop and gain in traffic, did you confirm it by looking at your server logs as well?

Or did you get all your data solely fro google WMT / GA ?

I ask because i remember a period a few years back when google traffic dropped about 90% for around a month before reappearing, accordin to google analytics. This contradicted what my server logs said.

Anyway, I apologize if this seems like a stupid question.

[Mentat]

I wish it was all a mistake, but Google Analytics and WMT are in sync + Adsense revenue...

There is no spoon!

[Sand]

I'm going to guess that it was Panda. I had a site that was hit by Panda and recovered. Now, with each Panda update, I get more traffic. I saw a boost starting right around this time, though the Thanksgiving holiday makes it hard for me to pinpoint the exact day.

[DansSitesRScrewed]

Sand, Did you do anything special to help your site recover?

[Sand]

I really just took inventory of everything on the site and identified pages that could have been much better. Then, depending on their importance to the site, I either made them much stronger or deleted them altogether. That's it, though it took me 6+ months of dedicated work to actually do it.