How to Set Up a High Performance Cluster (HPC) Using Debian Lenny and Kerrighed

There are many guides found on the net describing Kerrighed and how to set it up using Ubuntu and others.  However, to the best of my knowledge there isn’t a step by step guide specifically designed for Kerrighed using Debian Lenny.  So here it is.  You can set up your own Beowulf Cluster using Debian Lenny and Kerrighed in about 50 steps.  Many of the steps described here are taken straight from other guides because there are applicable here (see sources at the bottom.)  Many other steps are based on my own trial and error.
Continue reading…

 

cpulimit – Limit the cpu usage of a process

cpulimit is a simple program that attempts to limit the cpu usage of a process (expressed in percentage, not in cpu time). This is useful to control batch jobs, when you don’t want them to eat too much cpu. It does not act on the nice value or other scheduling priority stuff, but on the real cpu usage. Also, it is able to adapt itself to the overall system load, dynamically and quickly.
Continue reading…