Storage Accessible on Discovery¶
There are two main storage systems connected to Discovery: /home and /scratch. These options have specific quotas and limitations. The list below details the storage options available to you on Discovery if you have an account on Discovery. These are storage options that are connected to Discovery, and you should use when working on Discovery. Every individual with an account on Discovery has both a /home and /scratch directory. Research groups can request additional storage on the /work storage system. Note that currently /work storage is not provisioned to individuals.
Important
The /scratch space is only for temporary storage. It is not backed up, and there is a purge policy for data older than 28 days on /scratch. Please review the /scratch policy on our Policy page: https://rc.northeastern.edu/policy/
- NAME:
/home/<yourusername>
whereyourusername
is your username, e.g./home/j.smith
- DESCRIPTION: You are given a
/home
directory automatically when your Discovery account is created. This storage is mainly intended for storing relatively small files such as script files, source code, software installation files, and other small files that you need for your work on Discovery. While it is permanent storage that is backed up and replicated, it is not performant storage. It also has a small quota, so you should frequently check your space usage (use a command such asdu -h /home/<yourusername>
where<yourusername>
is your user name, to see the total space usage). For running jobs and directing output files, you should use your/scratch
directory. - QUOTA: 75GB
- DESCRIPTION: You are given a
- NAME:
/scratch/<yourusername>
- DESCRIPTION: You are given a
/scratch
directory automatically when your Discovery account is created. Scratch is a shared space for all users. The total storage available is 1.8PB; however, while this is performant storage, it is for temporary use only. It is not backed up. Data on/scratch
should be moved as soon as possible to another location for permanent storage. You should run your jobs from/scratch
and direct your output files to your/scratch
directory for best performance, but it is best practice to move your files off of scratch to avoid any potential data loss. - QUOTA: N/A
- DESCRIPTION: You are given a
- NAME:
/work/<groupname>
- DESCRIPTION: Research groups can request additional storage on
/work
. A PI can request this extra storage through the New Storage Space request . This is a performant, persistent, and long-term storage that is meant for storing data being actively used for research. It can be accessed by all members of the research group who have access permissions to this directory.
Note
Your group can also request additional general data storage if needed. See :ref:general_storage for details about the storage options that are not associated with Discovery but are available to anyone affiliated with Northeastern University. Each group can request up to 35TB of free storage across all supplemental storage tiers: /work, /research and /nese.
- DESCRIPTION: Research groups can request additional storage on