Forum Moderators: open

Message Too Old, No Replies

Fast bot hitting Hard

         

Sparks

12:03 am on Dec 21, 2000 (gmt 0)



Hello everyone,
I'm new to lycos and I've noticed some bot hits from fast lately that I've listed below. My quesiton is, is this normal and how often after the bot visits the page(s) does
it usely index the pages into the database. I'm very sorry
if this question has been answered but I tried searching for the answer and couldn't come up with it. BTW, the bottom
to samples are just two of many hits just like it accross the server.

Thanks in advance for your input.

209.202.148.18 - - [20/Dec/2000:15:02:20 -0800] "GET /dir/ HTTP/1.0" 200 6109 "-" "FAST-WebCrawler/2.2-pre27 (crawler@fast.no; [fast.no...]
209.202.148.18 - - [20/Dec/2000:15:02:37 -0800] "GET /dir/ HTTP/1.0" 200 5262 "-" "FAST-WebCrawler/2.2-pre27 (crawler@fast.no; [fast.no...]

littleman

1:33 am on Dec 21, 2000 (gmt 0)



Yeah, it is pretty normal. They have hit my servers several thousand times in one day. As far as updates go, it doesn't seem to be predictable - anyone else seen an update pattern?

Sparks

6:48 pm on Dec 21, 2000 (gmt 0)



Okay Great.. Looks like hopefully I'll be playing the lycos
game soon :-)

I'll keep everyone posted on what happens

Thanks littleman