Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- MSIECrawler not obeying my robots.txt :(
diddlydazz - 2:42 am on Jan 12, 2002 (gmt 0)
32.97.239.35 It traces to Bedford, NH
I presume this is someone making it available offline Brett ?
Thread source:: http://www.webmasterworld.com/robots_txt/128.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com