Forum Moderators: open

Message Too Old, No Replies

WebFilter

         

wilderness

1:30 am on Feb 17, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



63.173.114.243 - - [16/Feb/2003:15:45:37 -0800] "GET /robots.txt HTTP/1.1" 200 2127 "-" "WebFilter Robot 1.0"
main page and categroy pages.

A new business for Sprint?
http: //www.getnetspective.com/
Not that I'm against employers moitoring their employee's.
Just not at my expense.

SetEnv add

jeremy goodrich

2:52 am on Feb 19, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Thanks for the heads up on that one. Some day, I must go through all these bots and ban them from my sites as well :)

wilderness

2:10 pm on Feb 22, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Initially I did a SetEnv on the UA.
This bot returned this AM to 403 robots.txt then removed the UA ID from its UA and proceded to spider.
As a result I've denied 63.173.114.

The UA with ID removed.
"Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; .NET CLR 1.0.3705)"

carfac

5:32 pm on Feb 22, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



wilderness:

What a creepy spider! Thanks for monitoring so close, will ban via IP!

dave