etap

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
etap [2017/06/11 04:47]
meesters
etap [2017/06/30 08:38]
meesters
Line 3: Line 3:
 When using etapfs you should acess these filesystem only within your job and not indicate paths on the command line with SLURM commands (e.g. ''​sbatch''​). Especially ''​stdout''​ should not be directed to ''/​etapfs''​ as this can prevent a job to be ended (even if the wall clock time limit is hit), if one such filesystem "​hangs"​. When using etapfs you should acess these filesystem only within your job and not indicate paths on the command line with SLURM commands (e.g. ''​sbatch''​). Especially ''​stdout''​ should not be directed to ''/​etapfs''​ as this can prevent a job to be ended (even if the wall clock time limit is hit), if one such filesystem "​hangs"​.
  
-This means that the ''​-o'',​ ''​-e''​ and ''​-D/​--workdir=<​path>''​ parameters of ''​sbatch''​ should not point to etapfs. However, copying within your script to etapfs is ok, e.g.:+This means that the ''​-o'',​ ''​-e''​ and ''​-D/​%%--%%workdir=<​path>''​ parameters of ''​sbatch''​ should not point to etapfs. However, copying within your script to etapfs is ok, e.g.:
  
 <code bash> <code bash>
Line 13: Line 13:
 </​code>​ </​code>​
  
-Likewise, pointing the output of subshells to etapfs is an alternate solution.+Likewise, pointing the output of subshells to etapfs is an alternate solution. ​ 
 +This helps the scheduler to clean up jobs. 
 + 
 + 
 +<WRAP center round info 80%> 
 +Also, you should not submit jobs when your actual working directory at the time of submit is on an etapfs. Instead, 
 +<code bash> 
 +#SBATCH --workdir=<​path outside etapfs>​ 
 +</​code>​ 
 +can intentionally be used to avoid the mentioned problems, whilst submitting from a working directory in etapfs. 
 +</​WRAP>​ 
  
-**Also, you should not submit jobs when your actual working directory at the time of submit is on an etapfs.** 
  
-This way, the scheduler will be impaired by lost file handles and be able to clean up jobs. 
  • etap.txt
  • Last modified: 2017/06/30 08:38
  • by meesters