MSIECrawler not obeying my robots.txt :(

any ideas ?

[diddlydazz]

in my robots.txt i have :

User-Agent:MSIECrawler
Disallow:/

Any ideas why it doesn't obey ?

Any help greatly appreciated

Dazz

[Brett_Tabke]

What's the ip?

[diddlydazz]

32.97.239.35

It traces to Bedford, NH

I presume this is someone making it available offline Brett ?

[Brett_Tabke]

Just making sure it wasn't an se running it.

Ya, it was someone just running a spider to scrap your site. Most of those don't even read the robots.txt, let alone obey it.

[diddlydazz]

Thanks Brett, I should just let them get on with it then :)

Thanks

Dazz