Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

IIS Log Hits vs Google Cache

         

shaunm

7:30 am on Aug 26, 2016 (gmt 0)

10+ Year Member Top Contributors Of The Month



Hello there,

After struggling so much with parsing the IIS log files with some of the free tools, services and excel (that crashed badly), I got my hands on ScreamingFrog log analyzer which I really liked instantly. But I hate how IIS servers stores .log files in different directories only to spend my time on merging them together.

There were this wow and ouch moments when I looked into the .log hits for past week. For many years, I was only using the GSC, Adobe Discover and Google index to know what URLs are performing best and whether the URLs are in Google index. But the log files reveals something that I didn't expect to see. We have solutions section on the site which are highly authoritative and informational and found on the first page of Google results for more than hundred of high competitive keywords. I don't see any of them being reported in the .log files which shattered my popular beliefs.

1. The Google cached date for the solutions pages are showing a recent cache with recent date. I don't want to get into why the cache date is not necessarily an indication of when Google crawled the URL, but still when it has the recent cache that could mean the the crawl might have happened very recently too. So, why don't I see that in my IIS logs?

2. How far the statement 'The recently crawled pages are more likely to rank higher than the pages that weren't crawled since long' true?

Thanks for answering :-)

shaunm

10:13 am on Aug 26, 2016 (gmt 0)

10+ Year Member Top Contributors Of The Month



Also, I just noticed that around 300 pages are reported under the 301 redirect status in the log file which we can say as pages part of the solutions pages. So, solution A ->301 redirect to solution B. In that case, why don't I see the final destinations which are the working pages with 200 ok response in the log hits? They are valid single redirect which Google is supposed to follow. They are not some nasty chain redirects that Google leave after a couple of redirects. I'm just confused and doubt the credibility of the the log file that I personally merged.

blend27

1:34 pm on Aug 26, 2016 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



-- But I hate how IIS servers stores .log files in different directories only to spend my time on merging them together. --

Have you spoken with your host about this issue?

I have sites that have all logs in one "logs" directory in plain text format. I have logs that are zipped after a second day retaining yesterday logs in .log format. I have sites that will do both what I just wrote IN ONE Folder for all SubDomains including www/none www.

loglizard, try that.I picked up a link here on WebmasterWorld.

maybe it is just a matter of configuration.