Question about google bots

[preenet]

I just moved my site to new server and I have been observing for google bots from log file.

when the bots ask for robots.txt ( which i don't have in my dir ) .
64.68.82.36 - - [18/Mar/2003:10:58:40 -0700] "GET /robots.txt HTTP/1.0" 404 278 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"

then the bot just gone..what 's happpend? why don't they search my index? I am so curious...any advice for me plz?

[hetzeld]

preenet,

The line shows that your server returned the right 404 header for a missing file...
The file robots.txt is used to prevent indexing of some files/directories. When that file is missing, it is interpreted as "all bots welcome" :)

Don't worry, GoogleBot will be back soon (should be less than 24 hours, that's how often she requests the robots.txt file)

Dan

[preenet]

thanks hetzeld.. I never know about this before