homepage Welcome to WebmasterWorld Guest from 23.22.217.122
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Visit PubCon.com
Home / Forums Index / Code, Content, and Presentation / Apache Web Server
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL & phranque

Apache Web Server Forum

    
Log Files Filling up FAST.
Just switched servers. Filled up 5 gigs over the weekend.
acimag




msg:4309834
 1:23 pm on May 9, 2011 (gmt 0)

So we run a pretty good webserver and we use rewrites throughout every piece of coding.

So now that we are on a new server the Log files are now filling fast. We did 5GB over the weekend. When they fill up the server does not run well. here is an example of what we are seeing.


65.11.111.12 - - [06/May/2011:10:22:06 --0500] [www.thisdomain.com/sid#1383a8c0][rid#13db4b40/initial] (4) RewriteCond: input='www.thisdomain.com' pattern='^thisdomain.com$' => not-matched
65.11.111.12 - - [06/May/2011:10:22:06 --0500] [www.thisdomain.com/sid#1383a8c0][rid#13db4b40/initial] (4) RewriteCond: input='www.thisdomain.com' pattern='^www.thisdomain.com$' => matched
65.11.111.12 - - [06/May/2011:10:22:06 --0500] [www.thisdomain.com/sid#1383a8c0][rid#13db4b40/initial] (2) [per-dir /home/user/public_html/] rewrite robots.txt -> http://www.thisdomainaswell.com/robots.txt
65.11.111.12 - - [06/May/2011:10:22:06 --0500] [www.thisdomain.com/sid#1383a8c0][rid#13db4b40/initial] (2) [per-dir /home/user/public_html/] explicitly forcing redirect with http://www.thisdomainaswell.com/robots.txt
65.11.111.12 - - [06/May/2011:10:22:06 --0500] [www.thisdomain.com/sid#1383a8c0][rid#13db4b40/initial] (1) [per-dir /home/user/public_html/] escaping http://www.thisdomainaswell.com/robots.txt for redirect
65.11.111.12 - - [06/May/2011:10:22:06 --0500] [www.thisdomain.com/sid#1383a8c0][rid#13db4b40/initial] (1) [per-dir /home/user/public_html/] redirect to http://www.thisdomainaswell.com/robots.txt [REDIRECT/301]
65.11.111.12 - - [06/May/2011:10:22:06 --0500] [www.thisdomainaswell.com/sid#137d2588][rid#13dbcc50/initial] (3) [per-dir /home/usernameb/public_html/] strip per-dir prefix: /home/usernameb/public_html/robots.txt -> robots.txt
65.11.111.12 - - [06/May/2011:10:22:06 --0500] [www.thisdomainaswell.com/sid#137d2588][rid#13dbcc50/initial] (3) [per-dir /home/usernameb/public_html/] applying pattern '^(.*)$' to uri 'robots.txt'
65.11.111.12 - - [06/May/2011:10:22:06 --0500] [www.thisdomainaswell.com/sid#137d2588][rid#13dbcc50/initial] (4) RewriteCond: input='www.thisdomainaswell.com' pattern='^thisdomainaswell.com$' => not-matched


Should I just turn logs off?

 

wilderness




msg:4309844
 1:58 pm on May 9, 2011 (gmt 0)

Should I just turn logs off?


Turning off your logs as the result of improper visitor activity is the wrong reaction.

What you need to do is determine the User Agents and IP ranges that are making these requests and take preventive action to deny them access.

phranque




msg:4310241
 7:16 am on May 10, 2011 (gmt 0)

i would look for a RewriteLog directive in the server config file and either remove/comment it or set RewriteLogLevel to 0.

acimag




msg:4310971
 8:24 pm on May 11, 2011 (gmt 0)

Yes we disabled it. It wasnt from bad people. Our server just gets used.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Code, Content, and Presentation / Apache Web Server
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved