lsf_gpu

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
lsf_gpu [2015/06/16 22:32]
meesters [GPU Usage]
— (current)
Line 1: Line 1:
-====== GPU Queues ====== 
- 
-The titan-Queues (''​titanshort/​long''​) currently include hosts i0001-i0009,​ while the gpu-Queues (''​gpushort/​long''​) include the hosts g0001-g0009. The titan-hosts carry 4 GeForce GTX TITAN, hence a usage request up to ''​cuda=4''​ can be selected (see below). In contrast the GeForce GTX 480 is installed on the gpu-hosts (for the ''​gpushort/​long''​ queues). Finally, for the tesla-Queues (''​teslashort/​long) 4 Tesla K20m cards are installed. 
- 
-The max. runtime is analogous to the other short/​long-Queues. 
- 
-====== GPU Usage ====== 
- 
-To use a GPU you have to explicitly reserve it as a resource in the bsub call: 
- 
-<code bash> 
-$ bsub -n 1 -R '​rusage[cuda=1]'​ -q gpulong ./​my_program 
-</​code>​ 
- 
-The code or application to be carried out needs to 
-  - be an executable script or program. 
-  - carry a [[http://​en.wikipedia.org/​wiki/​Shebang_%28Unix%29|shebang]]. 
- 
-While this is true for LSF in general, it is imposed for the GPU-resource requests. 
- 
-===== nodes ===== 
- 
-In the previous example 1 CPU is requested (''​-n 1''​) and 1 GPU (''​cuda=1''​). The actual number of GPUs available depends on the queue you are using. The following link gives an overview on the [[nodes|Compute Nodes]]. To associate hosts with queues, type 
-<code bash> 
-$ bqueues -l <​queuename>​ | grep HOSTS 
-</​code>​ 
-pick the resulting short name from the output and with  
-<code bash> 
-$ bhosts <​nodename>​ 
-</​code>​ 
-you will get the relevant hosts. 
- 
-===== Using multiple GPUs ===== 
- 
-If supported by the queue, you can request multiple GPUs like 
- 
-<code bash> 
-$ bsub -n 1 -R '​rusage[cuda=4]'​ -q titanshort ./​my_program 
-</​code>​ 
- 
-Be sure to add a sufficient time estimate with ''​-W''​. Also, multiple CPUs can be requested with the usual ptile option. 
- 
-===== Using multiple nodes ===== 
- 
-In order to use multiples nodes, you have to request entire nodes and entire GPU sets, e.g. 
- 
-<code bash> 
-$ bsub -q titanshort -n 2 -R '​span[ptile=1]'​ -R '​affinity[core(16)]'​ -R '​rusage[cuda=4] 
-</​code>​ 
- 
-Your job script / job command has to export the environment of your job. ''​mpirun''​ implementations do have an option for this (see your ''​mpirun''​ man page). 
  
  • lsf_gpu.1434486733.txt.gz
  • Last modified: 2015/06/16 22:32
  • by meesters