Both sides previous revision
Previous revision
Next revision
|
Previous revision
|
hpc:storage_on_hpc [2024/05/02 11:25] Gaël Rossignol |
hpc:storage_on_hpc [2024/05/02 13:51] (current) Gaël Rossignol [Cluster storage] |
This is the storage space we offer on our clusters | This is the storage space we offer on our clusters |
| |
^ Cluster ^ BeeGFS path ^ Total storage size ^ Nb of servers ^ Nb of targets per servers ^ Backup ^ Quota size ^ Quota number files ^ | ^ Cluster ^ Path ^ Total storage size ^ Nb of servers ^ Nb of targets per servers ^ Backup ^ Quota size ^ Quota number files ^ |
| Baobab | ''/home/'' | 138 TB | 4 | 1 meta, 2 storage | Yes (tape) | 1 TB | - | | | Baobab | ''/home/'' | 138 TB | 4 | 1 meta, 2 storage | Yes (tape) | 1 TB | - | |
| ::: | ''/srv/beegfs/scratch/'' | 1.0 PB | 2 | 1 meta, 6 storage | No | - | 10 M | | | ::: | ''/srv/beegfs/scratch/'' | 1.0 PB | 2 | 1 meta, 6 storage | No | - | 10 M | |
| Yggdrasil | ''/home/'' | 495 TB | 2 | 1 meta, 2 storage | Yes (tape) | 1 TB | - | | | ::: | ''/srv/fast'' | 5 TB | 1 | 1 | No | 500G/User 1T/Group | - | |
| ::: | ''/srv/beegfs/scratch/'' | 1.2 PB | 2 | 1 meta, 6 storage | No | - | 10 M | | | Yggdrasil | ''/home/'' | 495 TB | 2 | 1 meta, 2 storage | Yes (tape) | 1 TB | - | |
| | ::: | ''/srv/beegfs/scratch/'' | 1.2 PB | 2 | 1 meta, 6 storage | No | - | 10 M | |
| |
We realize you all have different needs in terms of storage. To guarantee storage space for all users, we have **set a quota on home and scratch directory**, see table above for details. Beyond this limit, you will not able to write to this filesystem. We count on all of you to only store research data on the clusters. We also count on your **to periodically delete old or unneeded files** and to **clean up everything when you will leave UNIGE**. Please keep on reading to understand when you should use each type of storage. | We realize you all have different needs in terms of storage. To guarantee storage space for all users, we have **set a quota on home and scratch directory**, see table above for details. Beyond this limit, you will not able to write to this filesystem. We count on all of you to only store research data on the clusters. We also count on your **to periodically delete old or unneeded files** and to **clean up everything when you will leave UNIGE**. Please keep on reading to understand when you should use each type of storage. |
| |
^ Cluster ^ path ^ Total storage size ^ Nb of servers ^ Backup ^ Quota size ^ Quota number files ^ | ^ Cluster ^ path ^ Total storage size ^ Nb of servers ^ Backup ^ Quota size ^ Quota number files ^ |
| Baobab | ''/srv/fast'' | 5 TB | 1 | No | 500G /user & 1TB by group | - | | | Baobab | ''/srv/fast'' | 5 TB | 1 | No | 500G by user & 1TB by group | - | |
| |
<note important>This storage will be erased on each maintenances.</note> | <note important>This storage will be erased on each maintenances.</note> |
| |
| ==== Quota ==== |
| |
| |
| As the storage is shared by everyone, this ensure a fair scratch usage and prevent users from filling it. We setup a quota based on the total size. |
| |
| You should clean up some data in your fast directory as soon as your jobs are finished. |
| |
====== Local storage ====== | ====== Local storage ====== |