Forum Moderators: open

Message Too Old, No Replies

Hidden Distributed Search Function in Google Toolbar

Great scoop :) about the Google toolbar

         

ROLAND_F

10:57 pm on Feb 24, 2002 (gmt 0)

10+ Year Member



Do you remember that I suggested Google to use the toolbar as a way to do Distributed computing so we could give back to google ???

They did it ! They are so smart they are really listening to us.

You know that the google toolbar is called the "NavClient".

Now, the Google toolbar look for a registry key called "DcClient".

I suspect that "DC" is for "Distributed Computing".

Have a look at the resouce in the Google Toolbar DLL
GoogleToolbar_en_1.1.53-deleon.dll you will find a "double helix" icon.

While searching for new button name I could add to my registry key buttonId I found this:

"DcTaskFoldingAtHome"
"DcTaskSimpleProtein"
"DcTaskPerfectNums"
"DcClientOnOrOff"
"DcClientMenu"

I think that I will not sleep tonight, I'm so excited :).

Added: [foldingathome.stanford.edu...]
[toolbar.google.com...]

Key:
HKEY_CURRENT_USER\Software\Google\NavClient\1.1\Options\

Add Binary Value "EnableDC" value "1".

ROLAND_F

11:43 pm on Feb 24, 2002 (gmt 0)

10+ Year Member



What can you do with the little tomato ? There is nothing in the drop down menu :(.

I would like to enable the vertical PageRank display to save space, how can I do that ?

rjohara

12:07 am on Feb 25, 2002 (gmt 0)

10+ Year Member



Hmm, will there be a SETI@Home option also, or is Stanford not going to let Berkeley in on its territory? ;)

RJO

ROLAND_F

12:56 am on Feb 25, 2002 (gmt 0)

10+ Year Member



Chris_R,
Join the google team by enabling the DcClient, the Google Team is only 77 out of 1752, it should be #1 :).

Inktomi is 98 so event with non-SE related things google is the best :).

Chris_R

1:55 am on Feb 25, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I will try it soon - I used to be pretty active with Prime95 and did some of the code breaking stuff as well.

Would like to know if google cares if we use this undocumented feature.

I have about 16 computers laying around...

Too bad most are 486s

ROLAND_F

6:21 am on Feb 25, 2002 (gmt 0)

10+ Year Member



This stuff seems stable and this "undocumented feature" has a FAQ page, a team at google to reply to emails, ... There is already a small number of people testing it, with more people the team will crunch more work unit and the google name will go toward the top.
If they put the client on all their 10000+ server they will be number 1 in an hour ;).

In fact the process that crunch number is a separate process, the toolbar seems to be able to launch multiple distributed computing project. The toolbar act as a lightweight interface to some command line software. The number cruncher is started at PC startup time is independant.

ROLAND_F

6:54 am on Feb 25, 2002 (gmt 0)

10+ Year Member



It seems that there is a "Search My Enterprise" feature, maybe in relation with the Search Appliance.

Chris_R

11:19 am on Feb 25, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Ahh - I didn't see that - I have been slacking.

Maybe in the future they will make their own DC project - like computing PageRank :)

Chris_R

12:47 pm on Feb 25, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



You might want to read a little bit about distributed computing first - it is somewhat confusing idea until you get the hang of it.

Basically - one server (or group of servers) acting as one - assigns mini tasks of a bigger tasks to smaller more numerous computers.

This has been used to break codes. Imagine a code that has 100 billion possibilities. The main server assigns min tasks of lets say a thousand to each computer that joins up, you, me, roland, and thousands of other people. It will say "Hey chris - go try codes 1 - 1000". It than temporarily blocks off 1 - 1000 and then assigns 1001 - 2000 to roland. When I finish - my computer reports back - "hey I tried 1 - 1000 and it wasn't one of them".

Then the server blocks off that range forever - and assigns me 2001 - 3000. Assigns you 3001 - 4000 and so on. I am sure you can see how this can work.

The beauty of it is it can be set to work in the background - so YOU can still use your computer, but it uses power not in use. While I am typing this message for example - my computer is only using probably 1% of its power - the other 99% is used to power the DC application.

There have been several people that have discovered the World's largest prime number (and are in [or were in] the guiness book of world records) for using simple home computers (one was a 486/75 I believe).

Anyway - it is a cool idea - and their are many uses for it.

If that wasn't what was confusing - then sorry for wasting your time :)

backus

12:59 pm on Feb 25, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Yeah, I understand it now. I've already got a cancer research program running from last year, and before that I had a UA Star research program running.

PsychoTekk

1:14 pm on Feb 25, 2002 (gmt 0)

10+ Year Member



i uploaded a reg-file
(if running Win98 the first line will have to be changed to "REGEDIT4")
www.psychotekk.de/extern/GT.reg
i hope i did not forget any feature ;)

Everyman

6:26 pm on Feb 25, 2002 (gmt 0)



I wake up with a smile because of Google. I go to bed with a smile because of Google. All day long I'm smiling because of Google.

Sheeeeesh! Resistance may be futile, but at least offer a token or two of independent thought.

Or, better yet, if you want to be assimilated, why do it half-assed? Put your machine in a box and ship it to Mountain View, with a note begging Google to add it to the Mighty Ten Thousand Servers.

That way I won't have to read all this "Google is God" stuff, because you won't have a machine to post it.

tedster

6:45 pm on Feb 25, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



If I run this, can I take it off my taxes as a charitable deduction? ;)

ROLAND_F

7:17 pm on Feb 25, 2002 (gmt 0)

10+ Year Member



Everyman you made me smile :).

You are right, I was a little bit too excited about what I found last night I should not post after midnight :).

The problem with distributed computing is that we may even do bio-weapon research for the us army without knowing it ;).

Of course there is a risk when the power is only in the hands of a few and having a mega-powerfull google may become a problem because if they are the only search engine left in a few year we will have no choice and their integrity may be a vague souvenir ...

I know that their Distributed Computing system is not altruistic, it's all about branding off course.

Anyway I was very happy this week-end, I succeded in getting the google hash function out of the toolbar dll, this was a great puzzle, I learned a little bit of assembly language and aquired skills that may be valuable in the future.

Now I will continue to make my own toolbar, I will give Teoma and Wisenut a try.

Everyman

8:13 pm on Feb 25, 2002 (gmt 0)



> Anyway I was very happy this week-end, I succeded in getting
> the google hash function out of the toolbar dll, this was a
> great puzzle, I learned a little bit of assembly language and
> aquired skills that may be valuable in the future.
>
> Now I will continue to make my own toolbar, I will give
> Teoma and Wisenut a try.

It's good that you're looking beyond Google, because if you start using your own code to extract PageRank from Google, they may take revenge on you. Be sure you're using an ISP with very dynamic IP numbers, and be sure not to use it more than a few times a day. Big Brother is watching you.

ROLAND_F

9:08 pm on Feb 25, 2002 (gmt 0)

10+ Year Member



I'm not interested in getting pagerank for my toolbar. I was only interested in the hash function and learning to reverse engineer something. The best place for PageRank is Google's backend. Putting PageRank in front of end user is rather useless. It's also for brand recognition, this is Google's secret sauce, like the formula of Coke :). In fact people like features, even if they don't use them, they like to have swiss army knives with 18 tools, word processor that could launch a satelite only by writing a few macro, ... The only thing Google had to do to record click stream data is to put a feature that really need to talk to the backend. It's clever. You know they are all from Stanford.edu, there is research there about using computer to influence people (http://www-pcd.stanford.edu/captology/) so I think that if they need advice they can afford to buy the best advice but they can also go ask to their PhD friends from Stanford :).

Note: I will not give away the hash, learn to do it yourself, I'm not an asm programmer, only using tools available and using google to find good documentation it took me +/- 4 days from start to finish, a skilled asm programmer could do it in less than 10min :). You will be more happy and will have a bigger smile on your face and be proud if you do it yourself ;).

Chris_R

9:40 pm on Feb 25, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Resistance is futile.

jest because you are paranoid doesn't mean everyone isn't out to get you.

Just because I love Google, doesn't mean I can't be objective.

I picked on their dishonest graph located:

[google.com...]

I think this is cool - that's all.

GoogleGuy

8:12 pm on Feb 26, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I dunno. If Google is doing something nice like making it easier for regular people to find medical cures (and I'm not ready to address that thread right now), how is that a bad thing? I mean, don't get me wrong--I'm suspicious of monopolies and Big Brothers. But Google isn't either one. We're talking about an application that people have to go search out on the web, and even then the toolbar requires people to opt in with informed consent. Why should anyone complain about something that people do in the privacy of their own homes, with fully informed consent? ;) Sometimes I wonder if you're trolling us for fun, Everyman. In a world filled to the brim with injustice, you're worried about potential injustice from the one company that has dedicated itself to impartial search results, protecting user privacy, and general good livin'. When we peel back the nicks, will we find out that Everyman works for the RIAA? (Just joking with you Everyman--I'm glad that you're here to keep us all on our toes, and I'm glad for your perspective.)

Roland, I think your enthusiasm is great. I'm not so keen about poking around inside the toolbar, but I love that you're so interested in these issues. If we ever create a power beta test group, we'll have to put you in it--as long as you keep that disassembler away. :)

Personally, I think would be tres cool if Google offered an easy way for regular people to help with big problems like cancer, protein folding or, you know, aliens.

Hunter

8:51 pm on Feb 26, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Personally, I think would be tres cool if Google offered an easy way for regular people to help with big problems like cancer, protein folding or, you know, aliens

I'd be very happy (as would many of my friends) if Google just persisited in offering an an easy way for "regular people" (including Google searchers) to find quality Web sites that do not have the resources to compete in deep pocket games with huge corporations.

GoogleGuy

9:13 pm on Feb 26, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Don't worry, we'll persist in offering that. :)

ROLAND_F

9:36 pm on Feb 26, 2002 (gmt 0)

10+ Year Member



Hi GoogleGuy, happy to see you :).

You know I don't want to make harm. I'm only want to understand things better, not to abuse them.

For the moment I trust google but imagine that somebody buy google and use the great technology in a bad way I think that we should have people able to keep google in the right way.

Using a disassembler, playing with registry, packet sniffer, debugger is really a good thing, it make you learn how things work. In fact these are the tools and technique used to detect "scumware".

Knowing how things work make you trust them more.

F.

GoogleGuy

2:25 am on Feb 27, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I know you're a good guy, Roland. I trust you to be nice as long as Google is a good company. Then I don't have to worry, cuz I'm pretty confident that we'll be a good company for a loong time.

About this thread in general: please be patient for a little while longer. :)

Brett_Tabke

5:47 am on Feb 27, 2002 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Ok, sure. I can see another flip side to this on the toolbar. Not so much a google "seti at home" type project to benefit only Google, but rather more of community service project?

ROLAND_F

6:25 am on Feb 27, 2002 (gmt 0)

10+ Year Member



I think that I've read that the PageRank algo is based on the trip of a "virtual random surfer" on the web. Does Pagerank would be usefull/correct/improved if instead of a "random surfer" google used clickstream data from all websurfers ?

Also with the current trend that almost all free website require subscription, I think that Google may one day require the use of the toolbar to pay by giving back a little percentage of your computing power. Imagine getting a "500 : Forbiden" error message if you are browsing without a Google Toolbar that would compute PageRank or the new "Topic PageRank" ?

Note: I'm sorry that my message are about the goods vs the bads, when I read what I say a second time I think I sound like a five year old kid but please remember that english is not my main language. Next time I post here I may try the google translation tool so if there is some problem it's not my fault ;).

(edited by: ROLAND_F at 7:23 am (utc) on Feb. 27, 2002)

ROLAND_F

6:47 am on Feb 27, 2002 (gmt 0)

10+ Year Member



I've read in an article pointed to in the thread about google infrastructure that Google is doing voice recognition research. Imagine thousand of people training the same central neural network...

ciml

2:50 pm on Feb 27, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I like the idea, and I'll be happy to put it on the Windows machines around here. Distributed computing has a good following already, but Google could bring it to a greater audience.

I still think that the 'people who clicked the smiley face for this page also clicked these...' feature would be nice.

Sounds like a large data depository would be needed for that, but according to some reports (in other places), Google seems to be tracking all of our searches and the pages we visit for some kind of international blackmail plot anyway. ;)

Calum

Slud

3:00 pm on Feb 27, 2002 (gmt 0)

10+ Year Member



Thanks for the .reg file Roland.

Has anyone had success with the "Report Stats" portion of the protein folding button?

I saw the toolbar running an extra process on my machine earlier, so it seems to be doing some work, but I can't identify that it's being sent in and processed properly.

Xoc

5:08 pm on Feb 27, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



The issue that concerns me is that I have code running on my machine, behind my firewall, that is reporting results back to Stanford. Do we have the source to that code? No?

Now I trust Google not to screw my machine. However, Google isn't writing the protein software--a bunch of college kids from Stanford are writing the software. What if one of them adds a routine that, besides computing protein folding, does a little malicious side work?

Info goes out over port 80, so no standard firewall setting will stop it.

If I ran a Fortune 500 company's computer network, I would be sending out a memo right now saying that if anyone installs this feature, they will be fired.

adev

7:01 pm on Feb 27, 2002 (gmt 0)

10+ Year Member



so... when is Google going to use DC to help index pages? :)

Everyman

8:15 pm on Feb 27, 2002 (gmt 0)



GoogleGuy says:

> In a world filled to the brim with injustice, you're worried
> about potential injustice from the one company that has
> dedicated itself to impartial search results, protecting user
> privacy, and general good livin'. When we peel back the nicks,
> will we find out that Everyman works for the RIAA? (Just joking
> with you Everyman--I'm glad that you're here to keep us all
> on our toes, and I'm glad for your perspective.)

GoogleGuy, you're no doubt a fine fellow, and we'd get along splendidly after some beers outside of earshot of Mountain View.

But based on the average age of the Googlers in Mountain View, my wild guess is that you were running around in diapers when the feds were prosecuting me for refusing to get drafted and fight in Vietnam.

The bottom line is this:

a) Google is collecting, absorbing, and indexing an incredible amount of information, at a level and efficiency that civilization has never seen before;

b) much of this is not publicly available (surfing history from cookie data, etc.);

c) even the stuff that is publicly searchable is made available at the pleasure of Google, Inc., and finally;

d) you don't control Google's future.

At least one software engineer at Google used to work for the National Security Agency and held a top-secret clearance, according to his resume (found using a Google search).

My job is to look beyond the cute colored letters on your home page and keep you all honest.

(edited by: NFFC at 8:46 pm (utc) on Feb. 27, 2002)

This 77 message thread spans 3 pages: 77