homepage Welcome to WebmasterWorld Guest from 54.161.192.61
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Code, Content, and Presentation / Apache Web Server
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL & phranque

Apache Web Server Forum

    
Log Files Filling up FAST.
Just switched servers. Filled up 5 gigs over the weekend.
acimag

5+ Year Member



 
Msg#: 4309832 posted 1:23 pm on May 9, 2011 (gmt 0)

So we run a pretty good webserver and we use rewrites throughout every piece of coding.

So now that we are on a new server the Log files are now filling fast. We did 5GB over the weekend. When they fill up the server does not run well. here is an example of what we are seeing.


65.11.111.12 - - [06/May/2011:10:22:06 --0500] [www.thisdomain.com/sid#1383a8c0][rid#13db4b40/initial] (4) RewriteCond: input='www.thisdomain.com' pattern='^thisdomain.com$' => not-matched
65.11.111.12 - - [06/May/2011:10:22:06 --0500] [www.thisdomain.com/sid#1383a8c0][rid#13db4b40/initial] (4) RewriteCond: input='www.thisdomain.com' pattern='^www.thisdomain.com$' => matched
65.11.111.12 - - [06/May/2011:10:22:06 --0500] [www.thisdomain.com/sid#1383a8c0][rid#13db4b40/initial] (2) [per-dir /home/user/public_html/] rewrite robots.txt -> http://www.thisdomainaswell.com/robots.txt
65.11.111.12 - - [06/May/2011:10:22:06 --0500] [www.thisdomain.com/sid#1383a8c0][rid#13db4b40/initial] (2) [per-dir /home/user/public_html/] explicitly forcing redirect with http://www.thisdomainaswell.com/robots.txt
65.11.111.12 - - [06/May/2011:10:22:06 --0500] [www.thisdomain.com/sid#1383a8c0][rid#13db4b40/initial] (1) [per-dir /home/user/public_html/] escaping http://www.thisdomainaswell.com/robots.txt for redirect
65.11.111.12 - - [06/May/2011:10:22:06 --0500] [www.thisdomain.com/sid#1383a8c0][rid#13db4b40/initial] (1) [per-dir /home/user/public_html/] redirect to http://www.thisdomainaswell.com/robots.txt [REDIRECT/301]
65.11.111.12 - - [06/May/2011:10:22:06 --0500] [www.thisdomainaswell.com/sid#137d2588][rid#13dbcc50/initial] (3) [per-dir /home/usernameb/public_html/] strip per-dir prefix: /home/usernameb/public_html/robots.txt -> robots.txt
65.11.111.12 - - [06/May/2011:10:22:06 --0500] [www.thisdomainaswell.com/sid#137d2588][rid#13dbcc50/initial] (3) [per-dir /home/usernameb/public_html/] applying pattern '^(.*)$' to uri 'robots.txt'
65.11.111.12 - - [06/May/2011:10:22:06 --0500] [www.thisdomainaswell.com/sid#137d2588][rid#13dbcc50/initial] (4) RewriteCond: input='www.thisdomainaswell.com' pattern='^thisdomainaswell.com$' => not-matched


Should I just turn logs off?

 

wilderness

WebmasterWorld Senior Member wilderness us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 4309832 posted 1:58 pm on May 9, 2011 (gmt 0)

Should I just turn logs off?


Turning off your logs as the result of improper visitor activity is the wrong reaction.

What you need to do is determine the User Agents and IP ranges that are making these requests and take preventive action to deny them access.

phranque

WebmasterWorld Administrator phranque us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 4309832 posted 7:16 am on May 10, 2011 (gmt 0)

i would look for a RewriteLog directive in the server config file and either remove/comment it or set RewriteLogLevel to 0.

acimag

5+ Year Member



 
Msg#: 4309832 posted 8:24 pm on May 11, 2011 (gmt 0)

Yes we disabled it. It wasnt from bad people. Our server just gets used.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Code, Content, and Presentation / Apache Web Server
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved