Slurp has visited a new site over 1,000 times so far this month. It always comes in pairs (ie two bots with diff IPs arrive within seconds of each other). The weird thing is they just look at the index page, never follow any links (all standard href links to inner pages). Is this normal? And if so, any ideas why it comes by so often if it won't look any deeper?
