MSIE Crawler

What is it?

[RichTC]

Hi all,

One bot that has been visiting one of the sites we work on is the "MSIE Crawler".

This bot has had a real good feast on the site some 100,000 hits in a day!.

Anyone know what it is? and what it feeds data to?

Thanks in advance

[volatilegx]

I could be wrong (it happens a lot), but I think MSIE Crawler is used by MSIE when you save a web page to disk.

[RichTC]

So, are you saying that you think that someone has coppied a lot of pages from this site onto disk?

100,000 Hits?

[Dijkgraaf]

See this thread [webmasterworld.com] about it.

Where they all from the same IP address? Then I'd possibly it is someone spoofing the UA with a bad bot.