homepage Welcome to WebmasterWorld Guest from 54.161.202.234
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Google / Google News Archive
Forum Library, Charter, Moderator: open

Google News Archive Forum

    
Parked domains with no backlinks crawled
How can this happen
Hissingsid




msg:179942
 4:41 pm on Jan 2, 2004 (gmt 0)

Hi,

I have a few domains parked at a fairly low life UK registrar agent. I recently paid for a .net and a .com version of my trademark. Anyway I jst went to look through my inventory of domains to see if I might be causing myself any problems and I checked out the logs for these two domains and the .com domain has been crawled by Googlebot. When I search link:www.domain.com on Alltheweb there are none showing.

Anyone know how this could happen. It was only registered mid September.

Many thanks

Sid

 

John_Caius




msg:179943
 5:02 pm on Jan 2, 2004 (gmt 0)

Are you using the Google toolbar?

dasboot




msg:179944
 5:05 pm on Jan 2, 2004 (gmt 0)

Hi Sid,

Google apparently crawls parked domains - I've no idea why - any experts from earlier threads care to advise?

Note1: I use the term 'expert' cautiously.

Note2: I think I know the registrar you're referring to. They're the ones without an address or phone number. I used to use one in Albania, but apparently there's one in the UK2. net effect is that you can't contact these guys.

Note3: But I really don't think this is a problem - see previous posts about people parking 238 separate domains.

[edited by: dasboot at 5:19 pm (utc) on Jan. 2, 2004]

pageoneresults




msg:179945
 5:17 pm on Jan 2, 2004 (gmt 0)

Google apparently crawls parked domains - I've no idea why - any experts from earlier threads care to advise?

Not really an expert, but a logical guess would be that those parked domains are set up as a 302 Found (temporary redirect) or even possibly 200 OK. Neither are doing any good. Any parked domains should be set up as a 301 if its the type-in traffic you are trying to capture.

dasboot




msg:179946
 5:23 pm on Jan 2, 2004 (gmt 0)

I don't think he's trying to capture anything - type-in traffic - o.k. - but he's clearly more worried about a possible penalty.

Like many honest webmasters, it seems to me he's trying to make sense of what has happened to his position in Google since they independently made a decision to ruin a few hundred thousand businesses because a quiet guy in a white coat suddenly found his voice and persuaded the administrators at Google to f*ck up the SERPs.

Doh!

[edited by: dasboot at 5:35 pm (utc) on Jan. 2, 2004]

seofreak




msg:179947
 5:29 pm on Jan 2, 2004 (gmt 0)

happened to me as well, not sure how.

.com was parked on .org, which has not external links whatsoever. next update it has the same PR and backlinks as .org

pageoneresults




msg:179948
 5:37 pm on Jan 2, 2004 (gmt 0)

Anyone having these types of issues may want to verify that the server headers being returned on those parked domains are correct.

Server Header Checker [searchengineworld.com]

If Google is picking up the main domain and a parked domain, that tells me that something is wrong in the server header response, possibly it is returning an HTTP Status 200 which means all is okay. That 200 status gives Google the okay to index that domain. Same goes for a 302 status.

I've seen Google effectively merge content from multiple domains. The problem is, you leave too much for them to figure out. I've seen the wrong domain get indexed and the main domain dropped out of the index. There are just so many things that can happen if all of this isn't set up properly.

From my experience, parking domains can lead to problems if you are not exactly sure how they need to be set up.

Trawler




msg:179949
 5:43 pm on Jan 2, 2004 (gmt 0)

Hissingsid> Parked domains being crawled.

----

Yes, aparentally google bot is going beserk, how they are getting the url's is a mystery to me, but they for sure are.

You can always do a 301, but if you need the ability to re-direct the traffic at will and frequently, a 302 affords more use. Thats what I use.

Me thinks google needs to get a grip on their methods. A 302 is a temporary re-direct and they should not be spidering it. To spider a 302 is a half --ed idea, most likley, some coporate no-body that hasen't a clue, though it would be a great idea.

I mean, the whole purpose of a 302 is for a temporary redirect of trafic from a domain. If it is to be permenent situation, than a 301 should be used. Basic 101 of web development.

Google is negating the very rules the web was built upon. It really is sad how one company with so much power can just throw away the basic rules.

Frankly, I am about done with them, as soon as there is a viable replacement for them, their bot getts the boot. In the meantime if what they are rewarding is links pages and other types of non revelant pages, than that what I will put out. By the TONS.

glengara




msg:179950
 6:02 pm on Jan 2, 2004 (gmt 0)

Maybe they're planning to expand Domain Park?
[google.com...]

dasboot




msg:179951
 6:13 pm on Jan 2, 2004 (gmt 0)

glengara - I think that's the answer.

(Google) DomainPark allows domain name registrars and large domain holders to unlock their parked page inventory.

That's what's happened Sid.

I'm not going to attend Church anymore, I'm going to Googleplex CA.

pageoneresults




msg:179952
 6:27 pm on Jan 2, 2004 (gmt 0)

glengara, good find from Google.

A 302 is a temporary re-direct and they should not be spidering it.

From the protocol...

The requested resource resides temporarily under a different URI. Since the redirection might be altered on occasion, the client SHOULD continue to use the Request-URI for future requests. This response is only cacheable if indicated by a Cache-Control or Expires header field.

Trawler, sometimes I get a little confused on this issue. I'm not too certain that I would want to 302 my parked domains. Why? What happens if a competitor starts linking to all of those 302'd domains? Does it have an adverse effect in the long run?

corpuscle




msg:179953
 6:36 pm on Jan 2, 2004 (gmt 0)

Do a search for the domain from the google homepage (not from the toolbar). You might find some results that contain links to your domain's homepage, but that do not have a high enough pagerank to qualify as a "link:" result.

pageoneresults




msg:179954
 6:40 pm on Jan 2, 2004 (gmt 0)

Trawler, I should also add that the 302 response has been handled differently by various entities. There are many complaints out there in various archives about how the 302 is not handled properly by some. That is why I usually don't recommend it as it does not appear to provide a foolproof way of temporarily redirecting a URI.

Jenstar




msg:179955
 7:17 pm on Jan 2, 2004 (gmt 0)

Maybe they're planning to expand Domain Park?

Even if they are planning on expanding DomainPark, the vast majority of webmasters don't have the requisite 750,000 page views of parked domains per month. I have had parked domains crawled well before Google launched their DomainPark.

Trawler




msg:179956
 2:32 am on Jan 3, 2004 (gmt 0)

pageoneresults>

Trawler, I should also add that the 302 response has been handled differently by various entities.

__

Yes this is very true. I have been really fortunate with all the engines - Except for google. The others stay away and do not index my parked domains. Maybe they don't know where they are, Who knows? - but google apparently does know.

In the past,the problem has not been as prevelant as it is now. (re-gards Google) Now Google even spiders parked domains that have no links going to them. Other than the whois I guess. I can't figure it out!

It really comes down to the value of the traffic from the parked domains and how often one has to move that traffic to another location.

In our arena, at certain times, we have well over 20,000 uniques daily from our parked domains.

There is no way I am going to give up my right and ability to freely move that traffic around. The way we are set up I can switch a chunk of that traffic to a different location at a moments notice, even for as little as 2 hrs, and then return it back, or send it to any other destination I need it at.

If I did this via 301, forget it, I would have to spend the rest of my life changing server commands.

I really believe all this BS of trying to "please google" is nothing but a waste of human resourses. I would rather devote my time developing content or improving my sites for the use of my visitors.

The thing that really burns my A-- is that I have at least 5, FIVE) absoultly worthless sites that we put up years ago, that have survived florida. They are simply one to three page dorway sites that today I am really embarresed to even look at them. Seo'ed the same as most of our other sites.

One site I have is a one page website that contains nothing but useless dribble about 8 or ten of subjects, 26 affiliates links going out to 26 different sponsers, a few inbound links on target for a certain keyword phrase from a PR5 site. I mean the page is a disgrace.

For this Google awards me the # 1 position in a relativley competative area. The site is trash. Dosen't even belong in even the top 100, yet we get # 1.

In the interim, a number of my content rich sites vanish from the serps. Why, because they were on target, yes seo'ed, but still very usefull for my users.

Dosen't make sense to me, google doesn't make sense either, and the revelancy of their serps is getting worse as we speak. Go figure!

Trawler

Trawler




msg:179957
 2:54 am on Jan 3, 2004 (gmt 0)

Jenstar>

I have had parked domains crawled well before Google launched their DomainPark.

---

Me too - but not very frequently. Certainley not like it now is.

Domain Park - Not really new for google.

About 4 years ago when google was struggling for traffic, they approached a number of domain holders (including myself) with a similiar program. At that time it was a percentage of the $ they received from the traffic.

We turned them down as we knew the traffic well, and easily could do better re-directing it to our own paysites.

Even today, there is no way we would give them the traffic, targeted traffic is GOLD.

Agree with you also - not many people would have 750,000 page views. The few that do, sure know the value, so google will have to pay big bucks to get them on board.

I think their Domain Park will dissapear in short order, didn't work before, why would it work now?

antrat




msg:179958
 3:31 am on Jan 3, 2004 (gmt 0)

Perhaps a page out there is linking to the parked domain(s)and that page is only in Google's index. Google is the only one that truly deep crawls the web like no other and will not show backlinks for pages with < PR 4

percentages




msg:179959
 4:02 am on Jan 3, 2004 (gmt 0)

Sid,

See [webmasterworld.com...]

Since that thread I have done some more tests with brand new and totally rediculous .org, .com, and .net domain names of the variety:

no-one-would-ever-type-this-domain-name-by-accident.org (actually much more obscure than that).

I can confirm that Google is indexing parked domains. The chances of these parked domains being accessed by accident are so remote that the odds of the toolbar or other causes are extremely miniscule.

Enough evidence and consistancy to convince me that the source of the Google crawl has to be from the registry info.

FYI: Similar obscure .US domains are not getting indexed. It only seems to apply to .com, .net and .org.

Jenstar




msg:179960
 6:04 am on Jan 3, 2004 (gmt 0)

Domain Park - Not really new for google.

I knew that Applied Semantics had DomainPark before it was bought by Google, but I did not realize Google had their own similar domain program that long ago.

More on the launch of DomainPark here [webmasterworld.com]

Hissingsid




msg:179961
 9:51 am on Jan 3, 2004 (gmt 0)

Hi Everyone,

I went to a Pantomime last night. Once the giant had been slain they all got married and lived happilly ever after. You can't even get away from this Google problem in the theatre ;)

Dasboot,

You guessed right. The place I have the domains parked does not allow much control of redirection. I've changed all of mine that were redirected to redirect to their holding page. Not sure if this will help though.

I still can't figure why I'm paranoid about duplication when my site is only dropped for two, two word terms but is #1 for closely related two and three word terms, but I am. As Mr Spock once said "Captain, it just cannot be correct, it is just not logical".

Thanks everyone for your advice on this one.

Best wishes

Sid

dirkz




msg:179962
 12:03 pm on Jan 3, 2004 (gmt 0)

> Google apparently crawls parked domains

What do you mean by "parked domain"?

A domain that's just registered and doesn't point to anything?
OR
A domain that is set up to redirect to another one?

Thanks for clarification.

Hissingsid




msg:179963
 12:55 pm on Jan 3, 2004 (gmt 0)

What do you mean by "parked domain"?

Hi Dirkz,

The domain I referred to is just registered and did nothing with. It points to a default holding page and this is done automatically by the registrar. It is a .com domain. The .net version has not been visited by googlebot. Both of them have been visited by Inktomi's robot.

Here's part of the log entry.
crawler13.googlebot.com - - [14/Dec/2003:17:14:52 +0000]
crawler14.googlebot.com - - [02/Jan/2004:20:15:08 +0000]

Each time it requested robots.txt and got a 404 and then HTTP/1.0 and got a 304.

Best wishes

Sid

dirkz




msg:179964
 1:10 pm on Jan 3, 2004 (gmt 0)

304, that's last modified. So I guess it's a 200 ok normally.

As for the original topic, this would mean that Google is either visiting every domain visited with a toolbar client or any newly registered domain.

> [google.com...]

How can anybody make money with that? what's the business model behind it?

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google News Archive
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved