lsf_gpu

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
lsf_gpu [2017/06/09 12:16]
meesters [GPU Queues]
— (current)
Line 1: Line 1:
-====== GPU Queues ====== 
- 
-The titan-Queues (''​titanshort/​long''​) currently include hosts i0001-i0009,​ while the gpu-Queues (''​infogpushort''​) include the hosts g0001-g0009 ((formally there have been the ''​gpushort/​long''​ queues on these nodes - access however is restricted.)). The titan-hosts carry 4 GeForce GTX TITAN, hence a usage request up to ''​cuda=4''​ can be selected (see below). In contrast the GeForce GTX 480 is installed on the gpu-hosts (for the ''​gpushort/​long''​ queues). Finally, for the tesla-Queues (''​teslashort/​long''​) 4 Tesla K20m cards are installed. 
- 
-====== GPU Usage ====== 
- 
-To use a GPU you have to explicitly reserve it as a resource in the bsub call: 
- 
-<code bash> 
-$ bsub -n 1 -R '​rusage[cuda=1]'​ -q gpulong ./​my_program 
-</​code>​ 
- 
-The code or application to be carried out needs to 
-  - be an executable script or program. 
-  - carry a [[http://​en.wikipedia.org/​wiki/​Shebang_%28Unix%29|shebang]]. 
- 
-While this is true for LSF in general, it is imposed for the GPU-resource requests. 
- 
-===== nodes ===== 
- 
-In the previous example 1 CPU is requested (''​-n 1''​) and 1 GPU (''​cuda=1''​). The actual number of GPUs available depends on the queue you are using. ​ 
- 
-===== Using multiple GPUs ===== 
- 
-If supported by the queue, you can request multiple GPUs like 
- 
-<code bash> 
-$ bsub -n 1 -R '​rusage[cuda=4]'​ -q titanshort ./​my_program 
-</​code>​ 
- 
-Be sure to add a sufficient time estimate with ''​-W''​. Also, multiple CPUs can be requested with the usual ptile option. 
- 
-===== Using multiple nodes and multiple GPUs ===== 
- 
-In order to use multiples nodes, you have to request entire nodes and entire GPU sets, e.g. 
- 
-<code bash> 
-$ bsub -q titanshort -n 2 -R '​span[ptile=1]'​ -R '​affinity[core(16)]'​ -R '​rusage[cuda=4] 
-</​code>​ 
- 
-In this example 2 entire titannodes will be used (also the CPU set). 
- 
-Your job script / job command has to export the environment of your job. ''​mpirun''​ implementations do have an option for this (see your ''​mpirun''​ man page). 
- 
-<WRAP alert> 
-//​**Attention**//​ 
- 
-Multiple GPU nodes require to take entire nodes. The entire GPU set has to be claimed and the entire CPU set - either by setting ''​affinity(core''​ or ''​ptile''​. 
-</​WRAP>​ 
  
  • lsf_gpu.1497003401.txt.gz
  • Last modified: 2017/06/09 12:16
  • by meesters