Google indexed a proxy copy of my site

[Nostalgic Dave]

I noticed today that Google has indexed a copy of my main page somehow through the <edited> proxy website. Naturally I am not at all happy about this. How can I block my pages from ever being accessed through this proxy? It strips off my ads!

Thanks,

DS

<Sorry, no specifics.
See Forum Charter [webmasterworld.com]>

[edited by: tedster at 6:01 pm (utc) on Jan. 30, 2007]

[shogun_ro]

I notice this too.
Did you check the server header response?
In my case it's a 302 redirect.
How can we block this?

[Nostalgic Dave]

I just checked, and yes for me it is showing a 302 status code. Do I need to worry about this too much? Can/will Google give me a penalty for this duplicate content?

[CainIV]

I have counted up to three major proxy servers within the last three weeks.

One was copying over 675 000 pages on the web. As usual, no contact information for the proxy server owner etc on the website, and sure enough, contextual ads on the site.

I contacted Google about this with a spam report. Two others popped up yesterday and show current cache dates for hundreds of thousands of copied pages on net.

Two are 302, one of them is basically copying content to its own site.

[shogun_ro]

Can/will Google give me a penalty for this duplicate content?

My site is penalized since 17 dec.

[trinorthlighting]

Go to the proxy site and find out the IP address of it.

Then, deny the IP from your server.

When google crawls the proxy site next time around the pages will fall out.

Also, report the proxy site as spam as well. Especially if it has doorway pages, sneaky redirects, etc...

[Nostalgic Dave]

"deny the IP from your server."

Ok, that is where I get lost. I don't have my own server, can I do this from my httpd.ini file?

[leadegroot]

Heck, you can handle it in htaccess. Search on
htaccess ip deny
and see which article speaks to you :)

[shogun_ro]

Go to the proxy site and find out the IP address of it.
Then, deny the IP from your server.

When google crawls the proxy site next time around the pages will fall out.

It works even it is 302 redirected?

I found:

AuthName "My Secret Area"
AuthType Basic
<Limit GET POST>
order allow,deny
allow from all
deny from 255.255.255.255 <========== Proxy ip
</Limit>

[trinorthlighting]

Contact your service provider if your not clear on how to do it. Do you have a control panel?

[pxc433]

I've noticed this as well, and have been quite alarmed since duplicate content is penalised (or devalued if you prefer).

I submitted a spam report to Google advising them of duplicate content about 6 weeks ago, but it is still there (albeit in supplemental).

Does anyone know how G is picking up our websites through proxies? Are competitors doing this?

Thanks for the tip about blocking the IP. I will.

[grandpa]

Would it be out of line to post the proxy IP's for the rest of us? I'd prefer to be proactive instead of reactive to this sort of thing.

[jatar_k]

>> Would it be out of line to post the proxy IPs for the rest of us?

yes it would be :)

[trinorthlighting]

Proxy sites are slick, most add on advertising. What they do is to type in your url into the proxy, then get a list of the proxy.com/yoururl.com and then do some good old fashioned link spamming on other sites blogs and message boards. That is how google picks up the urls.

Anyways, a published list would be hard to keep up with since most of these spammers change urls, ips, etc...

[shogun_ro]

Contact your service provider if your not clear on how to do it. Do you have a control panel?

I've a shared hosting with cpanel.It's a pro account.

[trinorthlighting]

Do you have a ip deny button in your cpanel? If you do, all you need to do is to click on it and add the ip.

If not, contact your service provider for instructions.

[shogun_ro]

How can you ban an IP when it's 302 redirected to another domain?
This mean to ban the visitor IP.

Google indexed this address [domain.com:88...] .
When you access this url your browser will be 302 redirected to www.mydomain.com

In Google the title&description are the same as my domain index page except the url.
I try to see if it works for other url's
IT WORKS! If I'll post in some blog the url's Google will index them.

[jdMorgan]

Go to the proxy site and type in your domain name and page URL. Note the time.
Go to your raw server access log, and using the time you noted above, find the proxy's request for your page.
Get the IP address from the entry in your log file, and ban that IP address (or a larger range including that IP address.)

Jim

[trinorthlighting]

Yes, you ban the proxy ip. Then when you go to the proxy, type in your site it will show a forbidden page instead of your content.

Make sure you also report the proxy site as spam to google. Then google will know and more than likely deindex the site.

[shogun_ro]

Go to the proxy site and type in your domain name and page URL. Note the time.
Go to your raw server access log, and using the time you noted above, find the proxy's request for your page.
Get the IP address from the entry in your log file, and ban that IP address (or a larger range including that IP address.)

I did that before my last post.
In browser address bar was listed my domain url.
In server log I see my IP.

[Nostalgic Dave]

I just banned the IP address for this proxy using Isapi_Rewrite and it worked. Surfing my site through the proxy site in question now serves up an error page instead. Now, as long as they don't change their IP address!

[MThiessen]

They just might change it, you need to keep an eye on it.

[shogun_ro]

I just banned the IP address for this proxy using Isapi_Rewrite

HOW?

[Nostalgic Dave]

I put this into my httpd.ini file:

RewriteCond %REMOTE_ADDR 255\.255\.255\.255
RewriteRule .* $0 [F]

Where, the numbers are replaced with whatever IP you wish to block.

[shogun_ro]

Ok, Thanks.
How can I do that with Apache's mod_Rewrite in .htaccess?

[shogun_ro]

Later:

1.I puted your code in .htaccess
2.Then I clicked the link via proxy listed in Google
3.I accessed my site with no problem.

Result:
Don't work!

[tedster]

Here's one of several threads I found through a site search on the topic:

Ban an IP [webmasterworld.com] using .htaccess