Filesystems¶
/home directory¶
Your home directory is where you arrive by default when you login to the cluster or any access/login node. It is mounted on /home/username. It is intended to store configuration files, dotfiles and small a lightweight data. Your shell refers to it as “∼” (tilde), and its absolute path is also stored in the environment variable $HOME. Hyperion's home directory is specific to the cluster and the data stored here should be relatively small since it is meant to permanently store the most relevant information for your research. Note that various kinds of configuration files are also stored here: .bash_profile, .tcshrc, .vimrc, etc.
The /home filesystem is shared between the login nodes and the computing nodes.
Tip
By default, your home directory allows access only to you, the owner. You can share this access by running chmod.
Check your /home usage¶
Since the usage of the /home filesystem is limited for each user to 50GB. It may be useful to check your occupation.
Keeping in mind that Hyperion cluster features three BeeGFS filesystems mounted (/scratch, /home and /data), three aliases have been created in order to check the quotas corresponding to each filesystem, being these getquota-home, getquota-scratch and getquota-data:
$ getquota-home
Checking quota in /home filesystem for user username
Quota information for storage pool Default (ID: 1):
user/group || size || chunk files
name | id || used | hard || used | hard
--------------|------||------------|------------||---------|---------
username | xxxx|| 56.00 KiB| 50 GiB|| 262281| 300000
Backups¶
No backup of these directories is performed.
/scratch filesystems¶
/scratch is a shared high performance storage that system provides access to large amounts of disk for short periods of time. It meant to be used as the work space for jobs.
Warning
You should use it only to submit jobs from and to redirect all your I/O.
Everytime a new user account is created the system will also create a subdirectory under /scratch filesystem of the form /scratch/username.
Remember that /scratch filesystems are not meant to be used as a permanent storage solution. When the occupancy goes above 80% the BeeGFS filesystem shows a performance degradation that affects all users. The same applies with large numbers of small files, since the BeeGFS filesystem is not behaving ideally when dealing with high volumes of small files. Therefore, avoid having too many files (>1000) within the same directory.
Check your scratch usage¶
Since the usage of the /scratch filesystem is limited for each user to 1.5TB. It may be useful to check your occupation.
Keeping in mind that Hyperion cluster features three BeeGFS filesystems mounted (/scratch, /home and /data), three aliases have been created in order to check the quotas corresponding to each filesystem, being these getquota-home, getquota-scratch and getquota-data:
$ getquota-scratch
Checking quota in /scratch filesystem for user username
Quota information for storage pool Default (ID: 1):
user/group || size || chunk files
name | id || used | hard || used | hard
--------------|------||------------|------------||---------|---------
username | xxxx|| 43.81 GiB| 1.5 TiB|| 262281| 3000000
/lscratch filesystems¶
The fulfill the same role as /scratch filesystems. However, they are meant to be used by single node jobs that do not write to much to the disk. They are smaller in size compared to /scratch filesystems, but they are usually faster.
lscratch filesystems are mounted on /lscratch directory. Please, note that no user directory is created in the /lscratch systems and that you would need to create them yourself.
Please, once your jobs are finished make sure you remove all the files from the /lscratch.