Forum Moderators: phranque

Message Too Old, No Replies

Server Logs Text file

Need to Open a 312MB text file Quickly

         

shawn

7:09 pm on Jan 6, 2004 (gmt 0)

10+ Year Member



I have a program called 123Analyzer that procees my server logs. It is all done via unix commands and is very efficient when it comes to extracting the information for the logs and displaying it. It takes about 3-5 minutes to prepare 8 days worth of stats.

The problem is there is still some information that is in the text files that 123 does not give that I want to view - for example the exact search string from google that will show me how deep in the SERPS we are for that given term.

The problem is that the log from one day is about 250-350MB in size depending on the day.

WordpAd and MS Word will open them, however, it takes a toll on my Virtual memory and it takes forever to open.

Does anyone know an easy and quick way to open these text files?

Thanks,
Shawn

bcolflesh

7:10 pm on Jan 6, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Don't open it - grep for the info you want - on Windows:

wingrep.com/download.html

Dreamquick

7:12 pm on Jan 6, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Two ideas;

1) Import that data into a decent SQL database (mySQL, SQL Server etc)

2) You could use the windows "find" command with a pipe command to parse the interesting lines into a more managable file...

find /i "the text to find" C:\Dir\MyFile.txt > C:\Dir\MyFile_Hits.txt

- Tony

Zaphod Beeblebrox

2:24 pm on Jan 7, 2004 (gmt 0)

10+ Year Member



Try V: [fileviewer.com...]

shawn

3:32 pm on Jan 7, 2004 (gmt 0)

10+ Year Member



Everyone who has replied has been very very helpful. All those solutions worked very well!

I liked GREP, however, the "reffer" stays with the visitor as they go through the site so when I search for Google I get a lot of results I do not need. I am going to to talk to our programmer aguy and see about maybe filtering search strings in to the SQL database.

"The File Viewer" was also very easy to use and worked like a charm.

Again, thanks for eveyones help!

Shawn