Learning about Awk
There are a couple of brilliant command-line tools that one can use to deal with data in text files. One of these tools is Awk (The code is still available on Github)
- There is a useful introduction.
- As suggested on SO, read this book on AWK that is also just a great book.
- Dealing with 25Tb of data using Awk