Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- MSIECrawler not obeying my robots.txt :(

diddlydazz - 2:36 am on Jan 12, 2002 (gmt 0)


in my robots.txt i have :

User-Agent:MSIECrawler
Disallow:/

Any ideas why it doesn't obey ?

Any help greatly appreciated

Dazz

Thread source:: http://www.webmasterworld.com/robots_txt/128.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com