File Storage

SciServer provides two networked storage pools to store user data that can be accessed and used by all SciServer applications, in particular SciServer Compute: Storage and Temporary. Within each of these, users can create top level “User Volumes” within which they write data (folders and files), and which can be shared with other users.

• Storage volumes are permanent, backed up, and have quotas applied
• Temporary volumes allows users to temporarily store large datasets, but
  • space is shared between users
  • are not backed up
  • do not have quotas
  • should not be used for permanent storage

To ensure that Storage and Temporary storage do not become full, SciServer has introduced the following rules governing the allocation and reclamation of user space:

• SciServer currently allocates 10 GB of Storage storage for each user.
  • Attempts by users to exceed this allowance may fail.
  • SciServer reserves the right to delete a user's Storage data that is in excess of their allocation.
  • User requests for additional allocation will be considered on a per user basis.
• SciServer provides 80 TB total of shared Temporary storage space for all users.
  • SciServer reserves the right to delete data in the Temporary pool after a grace period of 72 hours.
  • The grace period begins at the creation of the file or folder.
  • Modifying a file or folder does not reset the grace period.
  • The oldest data files or folders will be deleted first.
  • User requests for additional Temporary storage or retention time will be considered on a per user basis.
• Users will be notified by email 24 hours before their Storage or Temporary data is deleted.

Database Storage

SciServer provide two storage options for databases that can be used with the SciServer CASJobs application. This follows a similar pattern to the File Storage allocation:

• MyDB: This is a private database for each user to store the results of CASJobs queries.
  • These databases are backed up
  • They are permanent
  • Tables can be shared with other users
• MyScratch: This is a shared temporary database to support the creation of “intermediate” datasets results from long or large queries, too big to fit into the MyDB.
  • This database is temporary and not backed up
  • The data will be deleted after a short retention period

To ensure that MyDB and MyScratch storage do not become full, SciServer has introduced the following rules governing the allocation and reclamation of user space:

• SciServer currently allocates 0.5 GB of MyDB storage for each user.
  • Attempts by users to exceed this allowance will fail.
  • User requests for additional allocation of MyDB will be considered on a per user basis.
• SciServer provides 80 TB total of shared MyScratch storage space for all users.
  • SciServer reserves the right to delete data in the MyScratch database after a grace period of 72 hours
  • The grace period begins at the creation of the database table.
  • Modifying a table does not reset the grace period.
• Users will be notified by email 24 hours before their MyScratch data is deleted.

SciServer's Data Storage Policy is subject to change. However, SciServer will not delete user data as a result of a policy change that decreases users' storage allocation.

SciServer tools and services may only be used for non-commercial purposes. Logging in and using the SciServer system implies your acknowledgement and acceptance of this policy.