Where to store files?

Note

Not all filesystems are equivalent

Choosing the appropriate storage location for your files is an essential step towards making your utilization of the cluster the most efficient possible. It will make your own experience much smoother, yield better performance for your jobs and simulations, and contribute to make PSMN a useful and well-functioning resource for everyone.

Here is where we recommend storing different types of files and data on PSMN:

  • personal scripts, configuration files, source codes and software installations, active datasets -> $HOME

  • group-shared scripts, source codes, software installations and active group-shared datasets -> /Xnfs/$GROUP

  • large temporary input files, temporary output of jobs, large checkpoint files -> $SCRATCH

  • curated output of job campaigns, backups, archives (cold datasets) [1] -> elsewhere, not on PSMN.

Warning

DO NOT STORE source codes, small files or symbolic links in $SCRATCH. It degrade performances very fast, for everyone.