Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Charlotte the spider
jdMorgan - 11:20 pm on May 17, 2006 (gmt 0)Thread source:: http://www.webmasterworld.com/search_engine_spiders/3252.htm
I saw this one, too. It read robots.txt, and then ignored it. I hope it likes 403s.
Brought to you by WebmasterWorld: http://www.webmasterworld.com