OpenFOAM

OpenFOAM is a free, open source CFD software package developed by OpenCFD Ltd at ESI Group and distributed by the OpenFOAM Foundation . It has a large user base across most areas of engineering and science, from both commercial and academic organisations. OpenFOAM has an extensive range of features to solve anything from complex fluid flows involving chemical reactions, turbulence and heat transfer, to solid dynamics and electromagnetics.

module load gcc/4.7.0
module load mpi/mvapich2/1.9/gcc_4.7.0
module load software/openfoam/mvapich2/2.3.0

setFields
decomposePar

bsub -n <CPUs> -W <TIME_MIN> -q <QUEUE> -R 'span[ptile=<CPU_PER_NODE>]' -app Reserve<MEMORY> -e <ERROR_FILE> -o <OUTPUT_FILE> -a mvapich2 mpirun -np <CPUs> <OPENFOAM_SOLVER> -parallel

bsub -n 64 -W 300 -q short -R 'span[ptile=64]' -app Reserve1800M -e err.txt -o out.txt -a mvapich2 mpirun -np 64 multiphaseInterFoam -parallel

bsub -n 64 -W 7200 -q long -R 'span[ptile=64]' -app Reserve1800M -e err.txt -o out.txt -a mvapich2 mpirun -np 64 multiphaseInterFoam -parallel

reconstructPar

• gcc/4.7.0
• mpi/openmpi/1.6.1/gcc_4.7.0

• software/openfoam/2.1.1

For using OpenFOAM you need to create a work space in your home directory. By default the work space is set by the environment variable $WM_PROJECT_USER_DIR and $FOAM_RUN as /home/<user>/OpenFOAM/<user>-2.1.1 and /home/<user>/OpenFOAM/<user>-2.1.1/run. You can change these variables by your needs, but be sure to do this every time you load OpenFOAM (because it will be resetted).

OpenFOAM has a lot of env vars which may be useful for your work (and they are used by OpenFOAM itself).