MSIECrawler

[zerillos]

I got a HUGE amount of hits from this in the last 24 hours

Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; MSIECrawler)

Can anyone please tell me what it is?

[encyclo]

MSIECrawler is usually (unless someone's spoofing it) the user agent for Internet Explorer when downloading your site for offline browsing. See:

[msdn2.microsoft.com...]

Also: [google.ca...]

It should respect robots.txt:

User-Agent:MSIECrawler
Disallow:/

[zerillos]

Thank you for your reply!