Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Scraping my own site to get listed again!

Tired of waiting..

         

cleanup

2:13 pm on Oct 7, 2005 (gmt 0)

10+ Year Member



How pervered is that...well its true.

I don't see google stepping back from the out of control dup filter just yet, so how else is can original content be listed on Google?

I will let you know how I get on.

FattyB

6:50 pm on Oct 7, 2005 (gmt 0)

10+ Year Member



Cleanup,

I noticed last week or so sites either aggregating and linking or just plain pinching our content appearing above us in results.

As you point out a solution might be to aggregate your own content on another site.

However, I think I will wait and see what the rest of the month brings before taking those measures. I would not go as far as to scrape our content, partly because I only have a single domain license on a lot of content. But a separate site/s aggregating news (headlines and snippet) from us and maybe some other is legitimate I think, if a little pointless.

I cannot believe Google will let such a situation stand for long since it will just lead to the above and further fairly pointless sites. I will give it a month and then...

Needs must when the devil drives!

cleanup

7:16 pm on Oct 7, 2005 (gmt 0)

10+ Year Member



Well, amazingly (and without foundation) I too have still have some confidence that Google might fix it. Meanwhile I am scraping my own site and duplicating it on another.

I will block all the other well behaved, search engines, as they are all indexing and producing SERPS in a more or less logical manner.

No, this is just a workaround until Google stops going GaGa.

andrea99

7:46 pm on Oct 7, 2005 (gmt 0)



When my site was banned by Google in July I removed my 40 best pages and made them into a new site. Google indexed this and it remained in the sandbox getting only 10% of the traffic these pages received at the old domain.

When my site was reincluded in September I moved the pages back to the original site and now they are getting almost the same traffic as before the ban.

Go figure. Well I hope that helps. Also I blocked Google with a meta tag for googlebot on some pages that I thought might be offending it and Yahoo slurp inexplicably obeyed this--killed me with Y.

Google and the others will not immediately obey robots.txt and will index some pages for a while before they get this straightened out.

If you don't use AdSense you could simply deny IP 249.66. the whole block for G or corresponding IP's for M and Y.

moftary

11:05 pm on Oct 7, 2005 (gmt 0)

10+ Year Member



haha
Believe it or not I find it a very cleaver idea :)