4881
Comment:
|
← Revision 53 as of 2024-09-26 08:21:49 ⇥
4538
|
Deletions are marked like this. | Additions are marked like this. |
Line 2: | Line 2: |
||<rowstyle="font-weight: bold; text-align: center;">Storage Class||Name ||Path ||Host ||NAS ||Usage ||itet‑stor||Backup||Creation/Access||Remark || ||<|4^>SCRATCH ||<^>Scratch ||<^>/scratch(-second) ||<^> ||<^>local ||<^>temp. data ||<style="vertical-align: top; text-align: center; color: red; ">✗ ||<style="vertical-align: top; text-align: center; color: red; ">✗ ||<^>self service||<^>available on all ISG.EE managed LINUX clients active scratch cleaner || ||<^>Scratch Net ||<^>/scratch_net ||<^>remote linux client||<^>NFS ||<^>temp. data ||<style="vertical-align: top; text-align: center; color: red; ">✗ ||<style="vertical-align: top; text-align: center; color: red; ">✗ ||<^>self service||<^>available on dedicated ISG.EE managed LINUX clients, active scratch cleaner|| ||<^>Net Scratch ||<^>via itet-stor ||<^>itetnas01 ||<^>NFS ||<^>temp. data, non sharing ||<style="vertical-align: top; text-align: center; color: green; ">✓ ||<style="vertical-align: top; text-align: center; color: red; ">✗ ||<^>per default ||<^>(scratch cleaner) || ||<^>Proj Scratch ||<^>via itet-stor ||<^>itetnas03 ||<^>NFS ||<^>temp. data + sharing ||<style="vertical-align: top; text-align: center; color: green; ">✓ ||<style="vertical-align: top; text-align: center; color: red; ">✗ ||<^>on request ||<^>individual setup (scratch cleaner) || ||<|2^>HOME ||<^>User Home ||<^>/home/<user> ||<^>verdi ||<^>NFS SMB ||<^>private data, non sharing ||<style="vertical-align: top; text-align: center; color: green; ">✓ ||<style="vertical-align: top; text-align: center; color: green; ">✓ ||<^>per default ||<^> || ||<^>Ueb Home ||<^>/home/<ueb> ||<^>tasky ||<^>NFS SMB ||<^>ueb specific data ||<style="vertical-align: top; text-align: center; color: red; ">✗ ||<style="vertical-align: top; text-align: center; color: green; ">✓ ||<^>on request ||<^>No NETHZ/IAM accounts temporary lifetime || ||<|2^>PROJECT ||<^>Project (Home)||<^>/home/<proj> via itet-stor||<^>bluebay ||<^>NFS SMB ||<^>project data + sharing ||<style="vertical-align: top; text-align: center; color: green; ">✓ ||<style="vertical-align: top; text-align: center; color: green; ">✓ ||<^>on request ||<^> || ||<^>Institute NAS ||<^>via itet-stor ||<^><inst>nasNN ||<^>NFS SMB ||<^>project data + sharing ||<style="vertical-align: top; text-align: center; color: green; ">✓ ||<style="vertical-align: top; text-align: center; color: green; ">(✓) ||<^>on request ||<^>individual setup||<^> || ||<:^>SPECIAL ||<^>BeeGFS ||<^>/srv/beegfs02/scratch ||<^>benderstor ||<^>BeeGFS Client NFS||<^>temp. compute data ||<style="vertical-align: top; text-align: center; color: red; ">✗ ||<style="vertical-align: top; text-align: center; color: red; ">✗ ||<^>on request ||<^>BIWI owned storage||<^> || ||<|2^>ARCHIVE ||<^>Lagoon ||<^>via itet-stor ||<^>lagoon ||<^>NFS SMB ||<^>private (mid term) archive modifiable||<style="vertical-align: top; text-align: center; color: green; ">✓ ||<style="vertical-align: top; text-align: center; color: green; ">(✓) ||<^>on request ||<^>disaster recovery only||<^> || ||<^>LTS ||<^>/lts/<inst>lts ||<^>ID ||<^>NFS or SMB ||<^>long term archive invariant data ||<style="vertical-align: top; text-align: center; color: red; ">✗ ||<style="vertical-align: top; text-align: center; color: red; ">✗ ||<^>on request ||<^>special LTS user needed 2 copies geographical redundancy||<^> || |
= Overview of storage classes = ||<rowstyle="font-weight: bold; text-align: center;">Storage Class||Name||Path||Host||NAS||Usage||itet‑stor||Backup*||Creation/Access||Remark|| ||<|5^>SCRATCH||<^>Scratch||<^>`/scratch(-second`)||<^>local|| ||<^>temp. data***||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>self service||<^>Available on all ISG D-ITET managed LINUX clients<<BR>>(active scratch cleaner**)|| ||<^>Scratch||<^>`C:\Scratch`||<^>local|| ||<^>temp. data***||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>self service||<^>Available on all ISG D-ITET managed WINDOWS clients|| ||<^>Scratch Net||<^>`/scratch_net`||<^>remote linux client||<^:>NFS||<^>temp. data***||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>self service||<^> Composition of local harddisks, available on dedicated ISG D-ITET managed LINUX clients<<BR>>(active scratch cleaner**)|| ||<^>[[Services/NetScratch|Net Scratch]]||<^>via [[Workstations/FindYourData|itet-stor]]||<^>itetnas04||<^:>NFS||<^>temp. data***, non sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>per default||<^>(scratch cleaner**)|| ||<^>Proj Scratch||<^>via [[Workstations/FindYourData|itet-stor]]||<^>itetnas04||<^:>NFS||<^>temp. data*** + sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>on request||<^>Individual setup<<BR>>(scratch cleaner**)|| ||<|2^>HOME||<^>[[NewLinuxUser#Where_to_put_your_data|User Home]]||<^>`/home/<user>`||<^>verdi||<^:>NFS<<BR>>SMB||<^>private data, non sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: green; ">✓||<^>per default||<^>|| ||<^>Ueb Home||<^>`/home/<ueb>`||<^>tasky||<^:>NFS<<BR>>SMB||<^>ueb specific data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: green; ">✓||<^>on request||<^>No NETHZ/IAM accounts<<BR>>Temporary lifetime|| ||<|2^>PROJECT||<^>[[Services/ProjectData|Project (Home)]]||<^>`/home/<proj>`<<BR>>via [[Workstations/FindYourData|itet-stor]]||<^>bluebay||<^:>BeeGFS Client<<BR>>SMB||<^>project data + sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: green; ">✓||<^>on request|| || ||<^>Institute NAS||<^>via [[Workstations/FindYourData|itet-stor]]||<^><inst>nasNN||<^:>NFS<<BR>>SMB||<^>project data + sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: green; ">(✓)||<^>on request||<^>Individual setup|| ||<:^>SPECIAL||<^>BeeGFS||<style="vertical-align: top; white-space: nowrap;">`/srv/beegfs02/scratch`||<^>benderstor||<^:>BeeGFS Client||<^>temp.*** compute data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>on request||<^>BIWI owned storage|| ||<|2^>ARCHIVE||<^>[[Services/DataArchivingNG|Lagoon]]||<^>via [[Workstations/FindYourData|itet-stor]]||<^>lagoon||<^:>BeeGFS Client<<BR>>SMB||<^>private (mid term) archive modifiable||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: green; ">(✓)||<^>on request||<^>Backup for disaster recovery only|| ||<^>[[Services/LTSArchiving|LTS]]||<^>`/lts/<inst>lts`||<^>ID||<^:>NFS<<BR>>or<<BR>>SMB||<^>long term archive invariant data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>on request||<^>Special LTS user is needed for access <<BR>> Two copies of data exists, geo-redundant on two ETH locations || * '''For storage without backup: Make sure to backup stored data yourself!''' ** For the scratch cleaner's documentation see `man scratch_clean` *** Where 'temporary' means, data can be reproduced easily. Or in other words, data is gone, no problem, wasn't so important, can be reproduced. |
Overview of storage classes
Storage Class |
Name |
Path |
Host |
NAS |
Usage |
itet‑stor |
Backup* |
Creation/Access |
Remark |
SCRATCH |
Scratch |
/scratch(-second) |
local |
|
temp. data*** |
✗ |
✗ |
self service |
Available on all ISG D-ITET managed LINUX clients |
Scratch |
C:\Scratch |
local |
|
temp. data*** |
✗ |
✗ |
self service |
Available on all ISG D-ITET managed WINDOWS clients |
|
Scratch Net |
/scratch_net |
remote linux client |
NFS |
temp. data*** |
✗ |
✗ |
self service |
Composition of local harddisks, available on dedicated ISG D-ITET managed LINUX clients |
|
via itet-stor |
itetnas04 |
NFS |
temp. data***, non sharing |
✓ |
✗ |
per default |
(scratch cleaner**) |
||
Proj Scratch |
via itet-stor |
itetnas04 |
NFS |
temp. data*** + sharing |
✓ |
✗ |
on request |
Individual setup |
|
HOME |
/home/<user> |
verdi |
NFS |
private data, non sharing |
✓ |
✓ |
per default |
||
Ueb Home |
/home/<ueb> |
tasky |
NFS |
ueb specific data |
✗ |
✓ |
on request |
No NETHZ/IAM accounts |
|
PROJECT |
/home/<proj> |
bluebay |
BeeGFS Client |
project data + sharing |
✓ |
✓ |
on request |
|
|
Institute NAS |
via itet-stor |
<inst>nasNN |
NFS |
project data + sharing |
✓ |
(✓) |
on request |
Individual setup |
|
SPECIAL |
BeeGFS |
/srv/beegfs02/scratch |
benderstor |
BeeGFS Client |
temp.*** compute data |
✗ |
✗ |
on request |
BIWI owned storage |
ARCHIVE |
via itet-stor |
lagoon |
BeeGFS Client |
private (mid term) archive modifiable |
✓ |
(✓) |
on request |
Backup for disaster recovery only |
|
/lts/<inst>lts |
ID |
NFS |
long term archive invariant data |
✗ |
✗ |
on request |
Special LTS user is needed for access |
* For storage without backup: Make sure to backup stored data yourself!
** For the scratch cleaner's documentation see man scratch_clean
*** Where 'temporary' means, data can be reproduced easily. Or in other words, data is gone, no problem, wasn't so important, can be reproduced.