[TriLUG] Building a beowulf (or other) cluster

[Ron Kelley]

Greetings all,

I am working on a project that runs computational algorithms against some database data (sort of data mining) and am trying to scale the processing out to multiple nodes.  I was wondering if a beowulf cluster (or other cluster technologies) can help scale out the effort.  Our processing happens in batch jobs and can easily be run on multiple servers at the same time.  I would like to install some sort of distributed process management tool so we can enable N-nodes to run the computations simultaneously.

Does anyone have a background in building a beowulf cluster or have knowledge in an open-source process management tool we can use?



Thanks,

-----------------------------
Ron Kelley
rkelleyrtp at gmail.com