shell tips and tricks

[littleman]

If you either a) have a shell tip or a trick you'd like to share, or b) know of a good online resource for shell tips and tricks, please post away.

[Brett_Tabke]

Best one I've seen: (almost a book):
[nl.ijs.si...]

[sugarkane]

My current favourite is doing quick and dirty log analysis using a combination of grep, pipes and wc - eg

grep -i googlebot access.log ¦ grep -i "23/oct" ¦ wc -l

to show how many times googlebot has been around today, or

grep -i google.com access.log ¦ grep -iv googlebot ¦ wc -l

for how many referrals from google... etc.

Not exactly deep, detailed data, but useful for a quick buzz through to see if anything warrants a closer look.

[richcasto]

More quick and dirty log analysis: see what IP addresses are hitting the URL containing string the most:

awk '/string/ {print $1}' logfile ¦ sort ¦ uniq -c ¦ sort -nr

I love awk, sort and uniq!

[richcasto]

sugarkane: instead of doing this:

grep -i "23/oct" ¦ wc -l

you can simplify it:

grep -ic "23/oct" 

since c is the option to grep for count.

[littleman]

Here's a basic one:
grep '200 - "http://' *.log ¦ grep -c '200 - "http://'

Its a quick and dirty total referrer check.

[littleman]

I just realized that this exact grep would be useless to most of you, because it does not take into account local referrer. It works great for doorway domains though. ;)