I'm seeing Slurp get the same page twice within a short space of time (20 ~ 30 mins) using the same IP address. This only happens with a small proportion of pages crawled and did cause me to wonder whether something was wrong with my server.
However both logs and tests show no apparent problemes.
Has anyone else seen this? Is it just a Slurp peculiarity?
