-- Search Engine Spider and User Agent Identification
---- above the law? ignores ROBOTS.TXT
lucy24 - 9:17 am on May 17, 2013 (gmt 0)
Hee. Someone once came by my site asking for "humans.txt". (I naturally suspect someone from hereabouts, but can't prove it :)) I felt obliged to add one just on general principles. Can't remember now what it says, but I'm pretty sure the file is still there.