User Tools

Site Tools


filesystems:overview

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

filesystems:overview [2019/05/27 08:28] (current)
meesters
Line 1: Line 1:
 +====== File Systems on Mogon I and II ======
  
 +===== Filesystem Overview =====
 +
 +{{:​filesystems:​parallel_filesystems_both_clusters.png?​nolink&​400 |}} 
 +
 +Essentially IBM's [[https://​en.wikipedia.org/​wiki/​IBM_General_Parallel_File_System|GPFS (re-branded to "​Spectrum Scale"​)]] is Mogon I's file system, while Mogon II uses [[https://​en.wikipedia.org/​wiki/​Lustre_(file_system)|Lustre file system]]. Both are [[https://​en.wikipedia.org/​wiki/​Clustered_file_system|parallel file systems]], meaning that the data is accessible on every client (indicated by the small boxes in the figure).
 +
 +This distinction however is not absolute: The [[filesystems:​overview#​Project_Directories_on_Mogon_I|GPFS contents of the Mogon I project directories]] are exposed to Mogon II by means of [[https://​en.wikipedia.org/​wiki/​Network_File_System|NFS (Network File System)]], which is true for the [[filesystems:​overview#​The_HOME-Directory|home directory]] in particular.
 +
 +Note that the other direction (exposing Mogon II's content to Mogon I) is intended, but not realized, yet.
 +
 +Also note, that the different file systems and networks carry different properties, resulting in yet different best practices. These are outlined in the file system entries in this wiki.  ​
 +
 +
 +<WRAP center round important 80%>
 +In either case: Our filesystems are not a wastebasket for your data. The ZDV offers an [[archiving:​tsm|archiving system]] -- it is your responsibility to occasionally clean up or archive data.
 +</​WRAP>​
 +
 +
 +===== The HOME-Directory =====
 +
 +The ''​HOME''​ directory on Mogon I for each user is a link to ''/​gpfs/​fs1/​home/<​username>''​ visible as ''/​home/<​username>''​. On Mogon II this is the //same// directory, exposed by NFS.
 +
 +==== Purpose and Characteristics ====
 +
 +Whilst the project directories (resp. their underlying file systems) are optimized for I/O of many big files, the home directory obviously cannot match this property: Small scripts, configuration files, aggregated results, etc. -- this is what a home directory is for. Put negatively, this requires two [[:​policies_home_directory|restrictions or policies]]: **The home directory is not for heavy I/O((We regret that we had to [[:​policies_home_directory|limit the home directory to a million files]] to prevent abuses.)), particularly not on Mogon II, as it is exposed via NFS to this cluster.**
 +
 +Looking on it the other way around, scripts, code, config files, small text files may go here, without second thoughts.
 +
 +<WRAP center round info 80%>
 +Currently the home directories have the following default setting:
 +  * One million files per user
 +  * a quota of 300 GiB.
 +</​WRAP>​
 +
 +===== Project Directories on Mogon I =====
 +
 +On Mogon I a project may ask for a project directory. These directories are linked as ''/​project/<​projectname>''​ and may physically reside on different file systems. For quotas see our [[filesystems:​quotas|quota section]].
 +
 +  * Project directories should hold data relevant for a particular project. All data shared by members of this project should go here - it can and should be exchanged this way, to work collaboratively. Also, common data should only be stored once (e.g. reference data of a project) and not multiple times. If for your convenience you need several places, use soft links.
 +  * These directories may hold self-compiled software of a group. However, please check for a software'​s availability as a [[:​setting_up_environment_modules|module]] first or [[:​software|ask for a software to be installed in an optimized fashion]].
 +  * The gpfs file system of project directories is optimized for parallel I/O and big files((block size is 4 MB, meaning: each file smaller than 4 MB, will occupy 4 MB)) in contrast to the home directories (see above).
 +
 +
 +<WRAP center round important 80%>
 +This project mount point exists on Mogon II, too (via NFS). Please avoid heavy I/O there. Best, place all your job I/O to the lustre project or scratch directories (see below).
 +</​WRAP>​
 +
 +
 +===== Project Directories on Mogon II =====
 +
 +The project directory on Mogon II currently resides under ''/​lustre/​miifs01/​project/<​projectname>''​. An analogous link to ''/​m2_project/<​projectname>''​ as on Mogon I is intended, but not yet realized. ​
 +
 +==== Purpose ====
 +
 +The purpose of this filesystem (and the related mountpoint) obviously is to place all data relevant to the project, which is not volatile (in contrast to the scratch filesystem, see below).
 +
 +==== Quota ====
 +
 +See our [[filesystems:​quotas|quota page]] for further information.
 +
 +===== Scratch on Mogon II =====
 +
 +The scratch filesystem on Mogon II currently resides under ''/​lustre/​miifs03/​scratch/<​projectname>''​.
 + 
 +==== Purpose ====
 +
 +The purpose of this filesystem (and the related mountpoint) obviously is to place all data relevant to the project, which is //​volatile//​ (in contrast to the project filesystem, see above). ​
 +
 +==== Rules & Quota ====
 +
 +Currently, there is no quota. Data can be deleted at any time, yet:
 +
 +The only current policy is:
 +  * When the file system usage crosses a certain threshold (70 % full), files will be deleted automatically.
 +  * The deletion will start with the oldest files.
filesystems/overview.txt · Last modified: 2019/05/27 08:28 by meesters