Welcome to WebmasterWorld Guest from 50.19.34.234

Forum Moderators: Ocean10000 & incrediBILL & phranque

Message Too Old, No Replies

Log Files Filling up FAST.

Just switched servers. Filled up 5 gigs over the weekend.

     

acimag

1:23 pm on May 9, 2011 (gmt 0)

5+ Year Member



So we run a pretty good webserver and we use rewrites throughout every piece of coding.

So now that we are on a new server the Log files are now filling fast. We did 5GB over the weekend. When they fill up the server does not run well. here is an example of what we are seeing.


65.11.111.12 - - [06/May/2011:10:22:06 --0500] [www.thisdomain.com/sid#1383a8c0][rid#13db4b40/initial] (4) RewriteCond: input='www.thisdomain.com' pattern='^thisdomain.com$' => not-matched
65.11.111.12 - - [06/May/2011:10:22:06 --0500] [www.thisdomain.com/sid#1383a8c0][rid#13db4b40/initial] (4) RewriteCond: input='www.thisdomain.com' pattern='^www.thisdomain.com$' => matched
65.11.111.12 - - [06/May/2011:10:22:06 --0500] [www.thisdomain.com/sid#1383a8c0][rid#13db4b40/initial] (2) [per-dir /home/user/public_html/] rewrite robots.txt -> http://www.thisdomainaswell.com/robots.txt
65.11.111.12 - - [06/May/2011:10:22:06 --0500] [www.thisdomain.com/sid#1383a8c0][rid#13db4b40/initial] (2) [per-dir /home/user/public_html/] explicitly forcing redirect with http://www.thisdomainaswell.com/robots.txt
65.11.111.12 - - [06/May/2011:10:22:06 --0500] [www.thisdomain.com/sid#1383a8c0][rid#13db4b40/initial] (1) [per-dir /home/user/public_html/] escaping http://www.thisdomainaswell.com/robots.txt for redirect
65.11.111.12 - - [06/May/2011:10:22:06 --0500] [www.thisdomain.com/sid#1383a8c0][rid#13db4b40/initial] (1) [per-dir /home/user/public_html/] redirect to http://www.thisdomainaswell.com/robots.txt [REDIRECT/301]
65.11.111.12 - - [06/May/2011:10:22:06 --0500] [www.thisdomainaswell.com/sid#137d2588][rid#13dbcc50/initial] (3) [per-dir /home/usernameb/public_html/] strip per-dir prefix: /home/usernameb/public_html/robots.txt -> robots.txt
65.11.111.12 - - [06/May/2011:10:22:06 --0500] [www.thisdomainaswell.com/sid#137d2588][rid#13dbcc50/initial] (3) [per-dir /home/usernameb/public_html/] applying pattern '^(.*)$' to uri 'robots.txt'
65.11.111.12 - - [06/May/2011:10:22:06 --0500] [www.thisdomainaswell.com/sid#137d2588][rid#13dbcc50/initial] (4) RewriteCond: input='www.thisdomainaswell.com' pattern='^thisdomainaswell.com$' => not-matched


Should I just turn logs off?

wilderness

1:58 pm on May 9, 2011 (gmt 0)

WebmasterWorld Senior Member wilderness is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



Should I just turn logs off?


Turning off your logs as the result of improper visitor activity is the wrong reaction.

What you need to do is determine the User Agents and IP ranges that are making these requests and take preventive action to deny them access.

phranque

7:16 am on May 10, 2011 (gmt 0)

WebmasterWorld Administrator phranque is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



i would look for a RewriteLog directive in the server config file and either remove/comment it or set RewriteLogLevel to 0.

acimag

8:24 pm on May 11, 2011 (gmt 0)

5+ Year Member



Yes we disabled it. It wasnt from bad people. Our server just gets used.
 

Featured Threads

Hot Threads This Week

Hot Threads This Month