Forum Moderators: open

Message Too Old, No Replies

MSIE Crawler

What is it?

         

RichTC

10:33 pm on Feb 12, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Hi all,

One bot that has been visiting one of the sites we work on is the "MSIE Crawler".

This bot has had a real good feast on the site some 100,000 hits in a day!.

Anyone know what it is? and what it feeds data to?

Thanks in advance

volatilegx

4:41 pm on Feb 13, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I could be wrong (it happens a lot), but I think MSIE Crawler is used by MSIE when you save a web page to disk.

RichTC

11:00 pm on Feb 13, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



So, are you saying that you think that someone has coppied a lot of pages from this site onto disk?

100,000 Hits?

Dijkgraaf

11:10 pm on Feb 13, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



See this thread [webmasterworld.com] about it.

Where they all from the same IP address? Then I'd possibly it is someone spoofing the UA with a bad bot.