User Tools

Site Tools


job_arrays

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
job_arrays [2018/03/12 21:32]
meesters [Job Arrays in Slurm]
job_arrays [2019/03/27 11:55]
meesters [Purpose]
Line 7: Line 7:
 We strongly recommend, using parallel processing in addition and to use job arrays as a convenience feature, without neglecting performance optimization. We strongly recommend, using parallel processing in addition and to use job arrays as a convenience feature, without neglecting performance optimization.
  
 +===== Maximal Job Array Size =====
 +
 +You can look up the maximal job array size using the following command:
 +<code bash>
 +$ scontrol show config| grep MaxArraySize
 +</​code>​
 +
 +The reason we do not document this value is, that it is subject to change.
 +
 +<WRAP center round info>
 +**Why is there an array size limit at all?**
 +
 +If unlimited or if the limit is huge, some users will see this as an invitation to submit a large number of otherwise unoptimized jobs. The idea behind job arrays is to ease workflows, particularly the submission of a bigger number of jobs. However, the motivations to [[node_local_scheduling|pool jobs]] and to optimize still apply.
 +</​WRAP>​
 ===== Job Arrays in Slurm ===== ===== Job Arrays in Slurm =====
  
job_arrays.txt · Last modified: 2019/03/27 11:55 by meesters