Page is a not externally linkable
- Code, Content, and Presentation
-- Perl Server Side CGI Scripting
---- A Close to perfect .htaccess ban list


toolman - 3:31 pm on Mar 22, 2002 (gmt 0)


>>>>How can I check whether I did it correctly?

I like Sam Spade.org...a common tool lots of us use here. It will let you change your ua so you can test and also do head requests to see what kind of server someone is running on. A handy tool to use for diagnosing server troubles as well.

WOW. This has really bloomed. I'm glad to see so many people finding the rewrite script handy. I can't really take credit for it, as I just peiced together what littleman, Air, Gorufu and others posted for individual situations. I'm not so concerned with the email bots as I have no email addresses in my sites...except for that IndyLibrary one. That thing will shred your site in 2 seconds flat.

I'm more concerned with things like Front Page and other "theft" bots. One of the really cool aspects of that script is the blocking of that annoying iaea.org screen scraper or what ever it is. I dont think we've really figured out precisely what it is doing (it's certainly raised my awareness of atomic issues ;) ).

I'm just like the rest of you...learning regex as I go. It's a good time for some of the *nix geeks to shine. This has really brought out one of the strengths of WMW....the collective experience of webmasters pitching in to acheive a common goal.


Thread source:: http://www.webmasterworld.com/perl/687.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com