How can I determine the size of a directory or folder in Linux?
du -hs /path/to/directory -h: human-readable -s: summary (don't show size of each individual file within the...
Tutorial: How to use Linux Screen
A problem that often arises when you’re dealing with lots of data is that it takes forever to process. So you SSH into your Amazon EC2 machine,...
Automation: For loops in bash (for loops on the command line)
If you have to run a script that processes data for a particular file for a particular day, i.e. your file is on hadoop with the date in the path,...