|
Size: 33
Comment:
|
← Revision 53 as of 2024-09-26 08:21:49 ⇥
Size: 4538
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 1: | Line 1: |
| attachment:storage_overview.pdf | #rev 2020-09-04 davidsch = Overview of storage classes = ||<rowstyle="font-weight: bold; text-align: center;">Storage Class||Name||Path||Host||NAS||Usage||itet‑stor||Backup*||Creation/Access||Remark|| ||<|5^>SCRATCH||<^>Scratch||<^>`/scratch(-second`)||<^>local|| ||<^>temp. data***||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>self service||<^>Available on all ISG D-ITET managed LINUX clients<<BR>>(active scratch cleaner**)|| ||<^>Scratch||<^>`C:\Scratch`||<^>local|| ||<^>temp. data***||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>self service||<^>Available on all ISG D-ITET managed WINDOWS clients|| ||<^>Scratch Net||<^>`/scratch_net`||<^>remote linux client||<^:>NFS||<^>temp. data***||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>self service||<^> Composition of local harddisks, available on dedicated ISG D-ITET managed LINUX clients<<BR>>(active scratch cleaner**)|| ||<^>[[Services/NetScratch|Net Scratch]]||<^>via [[Workstations/FindYourData|itet-stor]]||<^>itetnas04||<^:>NFS||<^>temp. data***, non sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>per default||<^>(scratch cleaner**)|| ||<^>Proj Scratch||<^>via [[Workstations/FindYourData|itet-stor]]||<^>itetnas04||<^:>NFS||<^>temp. data*** + sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>on request||<^>Individual setup<<BR>>(scratch cleaner**)|| ||<|2^>HOME||<^>[[NewLinuxUser#Where_to_put_your_data|User Home]]||<^>`/home/<user>`||<^>verdi||<^:>NFS<<BR>>SMB||<^>private data, non sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: green; ">✓||<^>per default||<^>|| ||<^>Ueb Home||<^>`/home/<ueb>`||<^>tasky||<^:>NFS<<BR>>SMB||<^>ueb specific data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: green; ">✓||<^>on request||<^>No NETHZ/IAM accounts<<BR>>Temporary lifetime|| ||<|2^>PROJECT||<^>[[Services/ProjectData|Project (Home)]]||<^>`/home/<proj>`<<BR>>via [[Workstations/FindYourData|itet-stor]]||<^>bluebay||<^:>BeeGFS Client<<BR>>SMB||<^>project data + sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: green; ">✓||<^>on request|| || ||<^>Institute NAS||<^>via [[Workstations/FindYourData|itet-stor]]||<^><inst>nasNN||<^:>NFS<<BR>>SMB||<^>project data + sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: green; ">(✓)||<^>on request||<^>Individual setup|| ||<:^>SPECIAL||<^>BeeGFS||<style="vertical-align: top; white-space: nowrap;">`/srv/beegfs02/scratch`||<^>benderstor||<^:>BeeGFS Client||<^>temp.*** compute data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>on request||<^>BIWI owned storage|| ||<|2^>ARCHIVE||<^>[[Services/DataArchivingNG|Lagoon]]||<^>via [[Workstations/FindYourData|itet-stor]]||<^>lagoon||<^:>BeeGFS Client<<BR>>SMB||<^>private (mid term) archive modifiable||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: green; ">(✓)||<^>on request||<^>Backup for disaster recovery only|| ||<^>[[Services/LTSArchiving|LTS]]||<^>`/lts/<inst>lts`||<^>ID||<^:>NFS<<BR>>or<<BR>>SMB||<^>long term archive invariant data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>on request||<^>Special LTS user is needed for access <<BR>> Two copies of data exists, geo-redundant on two ETH locations || * '''For storage without backup: Make sure to backup stored data yourself!''' ** For the scratch cleaner's documentation see `man scratch_clean` *** Where 'temporary' means, data can be reproduced easily. Or in other words, data is gone, no problem, wasn't so important, can be reproduced. ##{{attachment:storage_overview_600dpi.jpg}} |
Overview of storage classes
Storage Class |
Name |
Path |
Host |
NAS |
Usage |
itet‑stor |
Backup* |
Creation/Access |
Remark |
SCRATCH |
Scratch |
/scratch(-second) |
local |
|
temp. data*** |
✗ |
✗ |
self service |
Available on all ISG D-ITET managed LINUX clients |
Scratch |
C:\Scratch |
local |
|
temp. data*** |
✗ |
✗ |
self service |
Available on all ISG D-ITET managed WINDOWS clients |
|
Scratch Net |
/scratch_net |
remote linux client |
NFS |
temp. data*** |
✗ |
✗ |
self service |
Composition of local harddisks, available on dedicated ISG D-ITET managed LINUX clients |
|
via itet-stor |
itetnas04 |
NFS |
temp. data***, non sharing |
✓ |
✗ |
per default |
(scratch cleaner**) |
||
Proj Scratch |
via itet-stor |
itetnas04 |
NFS |
temp. data*** + sharing |
✓ |
✗ |
on request |
Individual setup |
|
HOME |
/home/<user> |
verdi |
NFS |
private data, non sharing |
✓ |
✓ |
per default |
||
Ueb Home |
/home/<ueb> |
tasky |
NFS |
ueb specific data |
✗ |
✓ |
on request |
No NETHZ/IAM accounts |
|
PROJECT |
/home/<proj> |
bluebay |
BeeGFS Client |
project data + sharing |
✓ |
✓ |
on request |
|
|
Institute NAS |
via itet-stor |
<inst>nasNN |
NFS |
project data + sharing |
✓ |
(✓) |
on request |
Individual setup |
|
SPECIAL |
BeeGFS |
/srv/beegfs02/scratch |
benderstor |
BeeGFS Client |
temp.*** compute data |
✗ |
✗ |
on request |
BIWI owned storage |
ARCHIVE |
via itet-stor |
lagoon |
BeeGFS Client |
private (mid term) archive modifiable |
✓ |
(✓) |
on request |
Backup for disaster recovery only |
|
/lts/<inst>lts |
ID |
NFS |
long term archive invariant data |
✗ |
✗ |
on request |
Special LTS user is needed for access |
* For storage without backup: Make sure to backup stored data yourself!
** For the scratch cleaner's documentation see man scratch_clean
*** Where 'temporary' means, data can be reproduced easily. Or in other words, data is gone, no problem, wasn't so important, can be reproduced.