Unidentified deepcrawls

Mystery-bots

[Stefan]

I've had my entire site crawled overnight by two different IP#'s that didn't look for a robots.text and obviously weren't human.

This one 66.27.68.178 resolves but the site it's coming from doesn't show why they would scan my entire site. The IP# doesn't show on a site or Google search. Anyone know who this is? The second one, I found to be Zeus on a site search here.

Thanks

[Dreamquick]

ARIN claims the whole 66.27.*.* block is Road Runner, and if you do a reverse lookup it's name turns out to be 66-27-68-178.san.rr.com but since I'm not an american I have no idea what city SAN could be apart from San-Francisco.

The most obvious answer might be that it was a cable user running some kind of bot...

What user-agent were they using (if any)?

- Tony

[Stefan]

Sorry Dreamquick... I'm an idiot

I'd seen the second one, Zeus, and checked it, saw what it was, then saw what I thought was an earlier deepcrawl...

I just had a longer look and realized it was just someone who really liked my site, I guess. They came in via google.com and looked at almost all of the 50-odd pages, clicking through fairly fast.

Maybe if a moderator spots this they could delete it.

Thanks anyway Dreamquick