How does web robot work?

Want to know some detail about robots.

[torturedata]

I'm so happy to find this forum
Lots of good discussions
Can someone tell me where can I find more info. about the web robots? Such as when it is activated, how it retrieve links?
Thanks!

[jdMorgan]

torturedata,

Welcome to WebmasterWorld [webmasterworld.com]!

You might enjoy this one about Google, which includes some robots info:

The Anatomy of a Large-Scale Hypertextual Web Search Engine [www7.scu.edu.au]

Jim

[torturedata]

Good information,
Thank you!

[ukgimp]

A long rambling thread by me :)

But a lot of useful links in this one

[webmasterworld.com...]