User Tools

Site Tools


etap

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
etap [2017/06/11 04:47]
meesters
etap [2017/06/30 08:38]
meesters
Line 3: Line 3:
 When using etapfs you should acess these filesystem only within your job and not indicate paths on the command line with SLURM commands (e.g. ''​sbatch''​). Especially ''​stdout''​ should not be directed to ''/​etapfs''​ as this can prevent a job to be ended (even if the wall clock time limit is hit), if one such filesystem "​hangs"​. When using etapfs you should acess these filesystem only within your job and not indicate paths on the command line with SLURM commands (e.g. ''​sbatch''​). Especially ''​stdout''​ should not be directed to ''/​etapfs''​ as this can prevent a job to be ended (even if the wall clock time limit is hit), if one such filesystem "​hangs"​.
  
-This means that the ''​-o'',​ ''​-e''​ and ''​-D/​--workdir=<​path>''​ parameters of ''​sbatch''​ should not point to etapfs. However, copying within your script to etapfs is ok, e.g.:+This means that the ''​-o'',​ ''​-e''​ and ''​-D/​%%--%%workdir=<​path>''​ parameters of ''​sbatch''​ should not point to etapfs. However, copying within your script to etapfs is ok, e.g.:
  
 <code bash> <code bash>
Line 13: Line 13:
 </​code>​ </​code>​
  
-Likewise, pointing the output of subshells to etapfs is an alternate solution.+Likewise, pointing the output of subshells to etapfs is an alternate solution. ​ 
 +This helps the scheduler to clean up jobs. 
 + 
 + 
 +<WRAP center round info 80%> 
 +Also, you should not submit jobs when your actual working directory at the time of submit is on an etapfs. Instead, 
 +<code bash> 
 +#SBATCH --workdir=<​path outside etapfs>​ 
 +</​code>​ 
 +can intentionally be used to avoid the mentioned problems, whilst submitting from a working directory in etapfs. 
 +</​WRAP>​ 
  
-**Also, you should not submit jobs when your actual working directory at the time of submit is on an etapfs.** 
  
-This way, the scheduler will be impaired by lost file handles and be able to clean up jobs. 
etap.txt · Last modified: 2017/06/30 08:38 by meesters