Page is a not externally linkable
- Code, Content, and Presentation
-- Apache Web Server
---- Ban bots with no user agent


madmatt69 - 3:47 pm on Jan 21, 2010 (gmt 0)


Hi all recently my site stats show a bot that just sucked up over a gig of bandwidth. In my 'awstats' report it just defines it as:
Unknown robot (identified by empty user agent string)

Is it safe to assume that any 'legitimate' bot would have a user agent string?

If so, is there a way (via httpd.conf) to deny access to bots that are missing their user agent string?

Thanks!


Thread source:: http://www.webmasterworld.com/apache/4065060.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com