Welcome to WebmasterWorld Guest from 54.226.25.231

Message Too Old, No Replies

Lost in Google

     

rshandy

6:39 pm on Feb 27, 2005 (gmt 0)

10+ Year Member



My site has been in 1st page serps for many years. Just a few weeks ago, my listing went from a title display and decription to just this:

www.mydomain.com/
Similar pages

In addition, my Yahoo listing disappeared as well. I then did a Yahoo search for pages with my domain included and found most of my interior pages indexed but not my home page.

What happened? Is it possible my site was not ready to be crawled when Googlebot and Slurp robots visied my site - simultaneously?

This is a very "white hat" site - no tricks at all, just good content...

I went and manually requested my site be spidered on both Google and Yahoo, and sent an email to Yahoo requesting any explanation as well.

Is there anything else I can do? Any ideas of why this happened?

Lorel

5:22 pm on Mar 12, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



If those other two domains are only for the purpose of providing links to your main site and don't have any value of their own - I read somewhere in another thread that Google is starting to penalize this tactic because so many spammers are doing it.

stuuued

2:31 am on Mar 13, 2005 (gmt 0)

10+ Year Member



I suspect that my site has been hijacked. But I am new to all of this and are not even sure what a sktscraper site is. Maybe one of you can explain here. Also, my site is listed in my profile, anyone care to point out which (if any) have hijacked my site?

stinky

2:37 pm on Mar 15, 2005 (gmt 0)

10+ Year Member



I did a search in google with inurl:www.mysite.com and got back two results both with my domain. One had www.mysite.com with a discription and the other result looked just like this www.mysite.com%20/
Anybody have any ideas why a "%20/" showing up after my domain? I never used "%20/" in any of my page names.

stinky

3:48 pm on Mar 15, 2005 (gmt 0)

10+ Year Member



I did a search in google with inurl:www.mysite.com and got back two results both with my domain. One had www.mysite.com with a discription and the other result looked just like this www.mysite.com%20/
Anybody have any ideas why a "%20/" showing up after my domain? I never used "%20/" in any of my page names.

zeus

4:13 pm on Mar 15, 2005 (gmt 0)

WebmasterWorld Senior Member zeus is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Stinky - Its a link pointing to you that has a space in the link, thats all.

stinky

9:41 pm on Mar 15, 2005 (gmt 0)

10+ Year Member



When i did a search for allinurl:mysite.com i found this on google, www.domain.co.uk/link/link.php?id=42 it had my web site title and discription in serps, when i clicked the link it took me to my site. When i checked the site cach of that link i saw my home page. This site has my link on their link page but it is a straight html link. Why am i finding this redirect in the serps? Also when i search for allinurl:www.mysite.com the above link does not show up. Anybody have any ideas why? Should i e-mail this site and ask them to remove the redirect link i found in a search?
-thanks

jk3210

10:15 pm on Mar 15, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



<<link.php?id=42>>

When "link.php" querys the database looking for the value "id=42," guess what it finds.

(hint: your url)

<<Should i e-mail this site and ask them to remove the redirect link i found in a search?>>

Sure, they problably will remove it for you. But, Google won't. Why? Because everytime gbot goes back to "link.php?id=42" it finds valid content --yours.

claus

12:06 am on Mar 16, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Yes, it is no use to just remove the link. The script URL should return a "404 Not Found" otherwise you can not remove it from Google, and Googlebot will not flag it for removal either.

Emmett

12:20 am on Mar 16, 2005 (gmt 0)

10+ Year Member




Yes, it is no use to just remove the link. The script URL should return a "404 Not Found" otherwise you can not remove it from Google, and Googlebot will not flag it for removal either.

Claus,

When I had the redirect site remove my link, it now returns their home page. My concern is that if the link is no longer in their links list will googlebot ever re-index it and figure out that its pointing somewhere else now? Should I add a link to their script to my site just to get google to re-index it?

Thanks

jk3210

1:19 am on Mar 16, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



<<When I had the redirect site remove my link, it now returns their home page.>>

Big problem.

You must be able to type the EXACT original url into your browser address window and make sure your page no longer comes up. If it does come up, then that's what gbot will find when it re-spiders the link.

Simply having the offending link removed from the hijacker's page isn't enough. The problem is that the original url is still in Google's database and gbot keeps going back DIRECTLY to it --not via the hijacker's page.

And trying to get it removed via the URL console is no good because it still appears to be a live page to G.

If it doesn't return a 404, gbot won't remove it.

zeus

1:31 am on Mar 16, 2005 (gmt 0)

WebmasterWorld Senior Member zeus is a WebmasterWorld Top Contributor of All Time 10+ Year Member



How does it look with posts to news sites or papers, have reached a good site / company.

I know USToday had a little about scrapers and adsense so maybe they need a follow up about the lets say HUGE problem with redirecting links

Emmett

2:39 am on Mar 16, 2005 (gmt 0)

10+ Year Member




If it doesn't return a 404, gbot won't remove it.

It doesn't return a 404 now but it does point to their site instead of mine. I assume thats ok?

On a related note:
I found another (maybe only) source of my duplicate content penalty. In attempting to 301 redirect my ip address (left over from old setup) to the www site I was using the following code which google never seemed to understand (names changed and spaces added to protect the innocent):

Redirect 301 / http: //www. mysite. com/

I then changed it to (ip changed):
RewriteCond %{HTTP_HOST} ^123.45.678.9:69
RewriteRule (.*) http: //www. mysite. com$1 [R=301,L]

This redirected the browser from my ip address just fine and I didn't think anything of it until I put it through the WebmasterWorld Server Header Checker which was returning 200 OK!

So now I updated it to the following:
RewriteCond %{HTTP_HOST}!^.* mysite \.com [NC]
RewriteRule (.*) http: //www. mysite. com$1 [R=301,L]

The last entry seems to be returning the proper 301 redirect.

Just thought I would post this for anyone else having a split site problem. Given that 1 dupe offense = 30 day penalty, 2nd offense = 60 day and 3rd = 90 day, I don't expect to see my site listed in google for a long while :(

claus

10:03 am on Mar 16, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



When I had the redirect site remove my link, it now returns their home page. My concern is that if the link is no longer in their links list will googlebot ever re-index it and figure out that its pointing somewhere else now? Should I add a link to their script to my site just to get google to re-index it?

It's okay that it returns their home page if they are now 302 redirecting to themselves in stead of you.

As jk3210 wrote, Googlebot will pick the link from Google's own list of links at some point and spider it, regardless if it's found on the page or not. I don't know how long this will take, but it could take some time.

If you can enter the exact URL of the script in a server header checker (or in a browser with your User-Agent set to the full Googlebot UA string) and see another site than yours, then this particular link will no longer harm your site once Googlebot gets around to spider it.

You could try speeding things up by submitting the script URL to Google.

So now I updated it to the following:
RewriteCond %{HTTP_HOST}!^.* mysite \.com [NC]
RewriteRule (.*) http: //www. mysite. com$1 [R=301,L]

I would use this syntax in stead, but if yours works for you there's no need to change it:

----------------------------------
RewriteCond %{HTTP_HOST} !^www\.example\.com [NC]
RewriteRule (.*) http://www.example.com$1 [R=301,L]
----------------------------------

patoruzu

5:16 pm on Mar 16, 2005 (gmt 0)

10+ Year Member



A search with inurl:www.mysite.com shows this:

www.theirsite.com/world/chinese/web/body/www.mysite.com/?SLANG=zh&TLANG=ja&wb_lp=CHJA

Has theirsite.com hijacked mysite.com? Is mysite.com in trouble?

walkman

5:25 pm on Mar 16, 2005 (gmt 0)



"Has theirsite.com hijacked mysite.com?"
yes

"Is mysite.com in trouble?"
let's say it can't help you. Google might choose ignore them, you, or hurt both.

patoruzu

5:33 pm on Mar 16, 2005 (gmt 0)

10+ Year Member



Thank you, walkman. I've read that your site has been cloned by excite.co.jp, TOO. My problem is that some internal pages long indexed by Google have disappeared (though most not). I don't see any other explanation than this.

theBear

5:52 pm on Mar 16, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



A search with inurl:www.mysite.com shows this:

www.theirsite.com/world/chinese/web/body/www.mysite.com/?SLANG=zh&TLANG=ja&wb_lp=CHJA

That DOESN'T mean that they have hijacked anything although they COULD have.

The proper search is site:mysite.com and all the urls highlighted in green should be yours if they aren't then you have definately been jacked. On a large site these searchs aren't always easy.

IIRC inurl returns all of the pages that have a ANY type of link to your site, both good and so called bad.

And by jacking I don't mean just violating copyright, partially copying content, or scraping content.

There are too many things that get classified as hijacking.

stinky

7:36 pm on Mar 16, 2005 (gmt 0)

10+ Year Member



When I do a search on G for site:mysite.com the serps show pages from my site. Most of the page results have title and description and then there are some pages that just have my site’s url with no title or description. Why do some results show title description and some do not?

Also what is the difference between searching for site:mysite.com and site:www.mysite.com?

What is the best way to ask and explain to a webmaster to remove or/and fix a redirect link thats pointing to your site?

walkman

9:00 pm on Mar 16, 2005 (gmt 0)



I'm emailing Google with excite.co.jp examples. Can you please do the same. tell them to forward it to the Engineering Dept I guess. This has to stop now. I can't go broke because of this nonsense

zeus

9:03 pm on Mar 16, 2005 (gmt 0)

WebmasterWorld Senior Member zeus is a WebmasterWorld Top Contributor of All Time 10+ Year Member



walkman ad a link to thise tread also

crobb305

10:39 pm on Mar 16, 2005 (gmt 0)

WebmasterWorld Senior Member crobb305 is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Thank you, walkman. I've read that your site has been cloned by excite.co.jp, TOO

I had the same problem, but I was able to get the url removed in Google using their removal tool.

I'm emailing Google with excite.co.jp examples. Can you please do the same. tell them to forward it to the Engineering Dept I guess. This has to stop now. I can't go broke because of this nonsense

We all know that emailing them does no good. An email reader will open and delete the email.

I just can't believe we are stuck with the task of cleaning up Google's mess ourselves (using Google removal tool, emailing other webmasters, rewriting our content to remove duplication, etc). Ridiculous and just plain pathetic.

JohnKelly

6:40 pm on Mar 18, 2005 (gmt 0)

10+ Year Member



After reading up on 302 hijacking and this and other sites, I want to verify that the method I use to link to other sites is not contributing to the problem.

I use a tracking script to link to outside sites, like this:

[mydomain.com...]

I checked and this does generate a 302 in the header. BUT I am also blocking /dir/linker.php in my robots.txt:

Disallow: /dir/linker.php

Should I change the php script to use a 301 redirect instead of a 302? Or is keeping the script in the robots.txt good enough?

BTW, I'm also doing this to preserve PageRank... since these are not reciprocal links I didn't want to use the standard direct link.

Newwebguy1

12:49 am on Mar 19, 2005 (gmt 0)

10+ Year Member



My site is one of the unlucky ones brought to their knees by this flaw within Google. My question is does anyone have a theroy about what Google is doing about this disaster and more importantly how soon will we see this problem resolved? Will it be a week, a month, or in one of the major updates? Is there any hope for a site recovering after being crushed by this flaw within Google? Last, but not least I know Google is taking this very seriously as this problem could have a huge impact on their future earnings, but why won't they comment on the flaw which is causing quality sites to fall into a black hole? thanks in advance for any advice.

eyezshine

9:51 am on Mar 19, 2005 (gmt 0)

10+ Year Member



I had about 3 sites fall into the "Black Hole" in May 2004 and I finally figured out what happened to them in December 2004 but never found a way to fix the problem except for using the Google url removal tool which works good enough except my rankings still never came back to where they were before.

It was February 2005 when I used the URL remover so we'll see what happens in the next update.

Atticus

10:13 pm on Mar 21, 2005 (gmt 0)



As of last evening G is coming in third behind Y and MSN in my referrer logs. My listings continue to fall off a little more everyday. I'm being beat by pages with keyword blocks -- actual blocks of text at the bottom which are labeled "keywords," if you can believe it! I'm also being beat in one case by, "Important Announcement: This Web Site has been Discontinued." A real hot pick, that one...but why be bitter?

I have decided not to go crazy over this situation. I am going to pay more attention to ranking on Y and MSN.

I do have this sneaking suspicion that G will come back to me at some point, like a straying lover who returns with promises of happiness. Question is, will I fall for that old line again...

1milehgh80210

10:32 pm on Mar 21, 2005 (gmt 0)

10+ Year Member



" but why won't they comment on the flaw which is causing quality sites to fall into a black hole? "

IMO it's a flaw they can't fix. (if they could fix it, they would have by now).
So any official comment could lead to
-more bad guys finding out about the bug, and exploiting it.
-stock drop.

This 206 message thread spans 7 pages: 206
 

Featured Threads

Hot Threads This Week

Hot Threads This Month