Forum Moderators: open

Message Too Old, No Replies

being bombed by the google fresh bot

is it safe?

         

indiandomain

3:58 am on May 6, 2003 (gmt 0)

10+ Year Member



an hour back i was getting around 14 freshbots per minute.
isnt that too much for a bot visit?

has anyone seen their servers crash due to the bot visit?

eraldemukian

4:18 am on May 6, 2003 (gmt 0)

10+ Year Member



nope.
I would barely call 14 requests in a minute 'being bombed'.
How many requests your server can handle depends entirely on its setup. apache under linux for instance should be able to handle such an amount on a PentiumII without breaking into sweat.

However, freshbot was doing its thing very swiftly today on my site:
I had 433 visits during a specific minute (just randomly sampled, while it was going on, there could be more or less).

It really all depends. Apache for instance has a neat little thing called

server-status

if enabled in the config you can very easily tell how your server is doing.

googlebot never crashed my server. Actually nothing really ever did.
But that is not my fault. Thats just Apache on linux.
{I know its the wrong forum for this. Just wanted to answer a question}