What is Googlebot like?

[aha7]

Hello,

What is Googlebot like? Is it a PHP script or a script written in another programming language? Is it one script or many scripts? I am not talking about the 100 (or so) algos that Google implements in their SE. I am inquiring about the robot that visits my site and fetches my pages. What is it like?

[jdMorgan]

Compact, optimized, and fast, I'd guess. I'm not sure if something better than "C" has come along recently, but I'd bet that's what they use -- compiled into the tightest, tiniest, most processor-feature-optimized machine code they can get...

Again, just a guess.

Jim

[MrStitch]

What's Google Bot like?

If I had to guess, I'd say it's something like that little yellow VW Bug... from the Transformers. Remember that guy? Soooo cool....

[theBear]

Maybe it is a semi-tamed recursive wget.

[malachite]

Generally amiable, insatiably greedy, and occasionally like a spoiled child when it throws its toys (and your site) out of the pram. ;)

[mattg3]

I thought the Google boys and girls were python lovers.

[jdMorgan]

Yes they are, but Python is an interpreted language -- Not something you'd want to use when replicating a running-full-time program across hundreds or thousands of PCs. I suspect they'll want to get the most bang for their buck -- Or in this case, the most work per Watt.

So, my money is on a compiled language with heavy optimization.

Jim

[pageoneresults]

What is Googlebot like?

Internet Borg. Googlebot is a Collective. Different languages for different tasks.

[JudgeJeffries]

Spot on P1R
"Borg - a powerful symbol in popular culture for any juggernaut against whom "resistance is futile"."

[mattg3]

Yes they are, but Python is an interpreted language

Wouldn't be my speed choice either .. but the strangest things have happened .. IBM BASICA maybe ..

[thecityofgold2005]

It looks exactly like Matt Cutts, only smaller by a factor of 1000.

[jonnno]

It looks exactly like a haggis

[rekitty]

Google bot is like a swarm of millions of genetically engineered mini Matts.

[mattg3]

It looks exactly like Matt Cutts, only smaller by a factor of 1000.

Google bot is like a swarm of millions of genetically engineered mini Matts.

Maybe all the guys that actually program it are now jealous that he gets all the glory and ......... the abuse. ;)

[BeeDeeDubbleU]

Actually I have seen it and it looks exactly like .....

..... A WIDGET :)