Differences between revisions 18 and 51 (spanning 33 versions)
⇤ ← Revision 18 as of 2020-09-24 09:57:18 →
Size: 3542
Editor: davidsch
Comment:
← Revision 51 as of 2024-09-26 07:32:01 → ⇥
Size: 4499
Editor: hgiger
Comment:
Deletions are marked like this. Additions are marked like this.
Line 5: Line 5:
||<rowstyle="font-weight: bold; text-align: center;">Storage Class||Name||Path||Host||NAS||Usage||itet‑stor||Backup||Creation/Access||Remark||
||<|4^>SCRATCH||<^>Scratch||<^>/scratch(-second)||<^>local|| ||<^>temp. data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>self service||<^>available on all ISG.EE managed LINUX clients active scratch cleaner||
||<^>Scratch Net||<^>/scratch_net||<^>remote linux client||<^:>NFS||<^>temp. data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>self service||<^>available on dedicated ISG.EE managed LINUX clients, active scratch cleaner||
||<^>[[Services/NetScratch|Net Scratch]]||<^>via ''itet-stor''||<^>itetnas01||<^:>NFS||<^>temp. data, non sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>per default||<^>(scratch cleaner)||
||<^>Proj Scratch||<^>via ''itet-stor''||<^>itetnas04||<^:>NFS||<^>temp. data + sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>on request||<^>individual setup (scratch cleaner)||
||<|2^>HOME||<^>User Home||<^>/home/<user>||<^>verdi||<^:>NFS<<BR>>SMB||<^>private data, non sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: green; ">✓||<^>per default||<^>||
||<^>Ueb Home||<^>/home/<ueb>||<^>tasky||<^:>NFS<<BR>>SMB||<^>ueb specific data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: green; ">✓||<^>on request||<^>No NETHZ/IAM accounts temporary lifetime||
||<|2^>PROJECT||<^>Project (Home)||<^>/home/<proj><<BR>>via ''itet-stor''||<^>bluebay||<^:>NFS<<BR>>SMB||<^>project data + sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: green; ">✓||<^>on request|| ||
||<^>Institute NAS||<^>via ''itet-stor''||<^><inst>nasNN||<^:>NFS<<BR>>SMB||<^>project data + sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: green; ">(✓)||<^>on request||<^>individual setup||
||<:^>SPECIAL||<^>BeeGFS||<style="vertical-align: top; white-space: nowrap;">/srv/beegfs02/scratch||<^>benderstor||<^:>BeeGFS Client<<BR>>NFS||<^>temp.  compute data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>on request||<^>BIWI owned storage||
||<|2^>ARCHIVE||<^>Lagoon||<^>via ''itet-stor''||<^>lagoon||<^:>NFS<<BR>>SMB||<^>private (mid term) archive modifiable||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: green; ">(✓)||<^>on request||<^>disaster recovery only||
||<^>LTS||<^>/lts/<inst>lts||<^>ID||<^:>NFS<<BR>>or<<BR>>SMB||<^>long term archive invariant data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>on request||<^>special LTS user needed 2 copies geographical redundancy||		 ||<rowstyle="font-weight: bold; text-align: center;">Storage Class||Name||Path||Host||NAS||Usage||itet‑stor||Backup*||Creation/Access||Remark||
||<|5^>SCRATCH||<^>Scratch||<^>`/scratch(-second`)||<^>local|| ||<^>temp. data***||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>self service||<^>Available on all ISG D-ITET managed LINUX clients<<BR>>(active scratch cleaner**)||
||<^>Scratch||<^>`C:\Scratch`||<^>local|| ||<^>temp. data***||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>self service||<^>Available on all ISG D-ITET managed WINDOWS clients||
||<^>Scratch Net||<^>`/scratch_net`||<^>remote linux client||<^:>NFS||<^>temp. data***||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>self service||<^> Composition of local harddisks, available on dedicated ISG D-ITET managed LINUX clients<<BR>>(active scratch cleaner**)||
||<^>[[Services/NetScratch|Net Scratch]]||<^>via [[Workstations/FindYourData|itet-stor]]||<^>itetnas04||<^:>NFS||<^>temp. data***, non sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>per default||<^>(scratch cleaner**)||
||<^>Proj Scratch||<^>via [[Workstations/FindYourData|itet-stor]]||<^>itetnas04||<^:>NFS||<^>temp. data*** + sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>on request||<^>individual setup<<BR>>(scratch cleaner**)||
||<|2^>HOME||<^>[[NewLinuxUser#Where_to_put_your_data|User Home]]||<^>`/home/<user>`||<^>verdi||<^:>NFS<<BR>>SMB||<^>private data, non sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: green; ">✓||<^>per default||<^>||
||<^>Ueb Home||<^>`/home/<ueb>`||<^>tasky||<^:>NFS<<BR>>SMB||<^>ueb specific data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: green; ">✓||<^>on request||<^>No NETHZ/IAM accounts<<BR>>temporary lifetime||
||<|2^>PROJECT||<^>[[Services/ProjectData|Project (Home)]]||<^>`/home/<proj>`<<BR>>via [[Workstations/FindYourData|itet-stor]]||<^>bluebay||<^:>BeeGFS Client<<BR>>SMB||<^>project data + sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: green; ">✓||<^>on request|| ||
||<^>Institute NAS||<^>via [[Workstations/FindYourData|itet-stor]]||<^><inst>nasNN||<^:>NFS<<BR>>SMB||<^>project data + sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: green; ">(✓)||<^>on request||<^>Individual setup||
||<:^>SPECIAL||<^>BeeGFS||<style="vertical-align: top; white-space: nowrap;">`/srv/beegfs02/scratch`||<^>benderstor||<^:>BeeGFS Client||<^>temp.*** compute data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>on request||<^>BIWI owned storage||
||<|2^>ARCHIVE||<^>[[Services/DataArchivingNG|Lagoon]]||<^>via [[Workstations/FindYourData|itet-stor]]||<^>lagoon||<^:>BeeGFS Client<<BR>>SMB||<^>private (mid term) archive modifiable||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: green; ">(✓)||<^>on request||<^>Backup for disaster recovery only||
||<^>[[Services/LTSArchiving|LTS]]||<^>`/lts/<inst>lts`||<^>ID||<^:>NFS<<BR>>or<<BR>>SMB||<^>long term archive invariant data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>on request||<^>Special LTS user needed <<BR>> Two copies -> geographical redundancy||

* '''For storage without backup: Make sure to backup stored data yourself!'''

** For the scratch cleaner's documentation see `man scratch_clean`

*** Where 'temporary' means, data can be reproduced easily. Or in other words, data is gone, no problem, wasn't so important, can be reproduced.

Overview of storage classes

Storage Class

Name

Path

Host

NAS

Usage

itet‑stor

Backup*

Creation/Access

Remark

SCRATCH

Scratch

/scratch(-second)

local

temp. data***

✗

✗

self service

Available on all ISG D-ITET managed LINUX clients
(active scratch cleaner**)

Scratch

C:\Scratch

local

temp. data***

✗

✗

self service

Available on all ISG D-ITET managed WINDOWS clients

Scratch Net

/scratch_net

remote linux client

NFS

temp. data***

✗

✗

self service

Composition of local harddisks, available on dedicated ISG D-ITET managed LINUX clients
(active scratch cleaner**)

Net Scratch

via itet-stor

itetnas04

NFS

temp. data***, non sharing

✓

✗

per default

(scratch cleaner**)

Proj Scratch

via itet-stor

itetnas04

NFS

temp. data*** + sharing

✓

✗

on request

individual setup
(scratch cleaner**)

HOME

User Home

/home/<user>

verdi

NFS
SMB

private data, non sharing

✓

✓

per default

Ueb Home

/home/<ueb>

tasky

NFS
SMB

ueb specific data

✗

✓

on request

No NETHZ/IAM accounts
temporary lifetime

PROJECT

Project (Home)

/home/<proj>
via itet-stor

bluebay

BeeGFS Client
SMB

project data + sharing

✓

✓

on request

Institute NAS

via itet-stor

<inst>nasNN

NFS
SMB

project data + sharing

✓

(✓)

on request

Individual setup

SPECIAL

BeeGFS

/srv/beegfs02/scratch

benderstor

BeeGFS Client

temp.*** compute data

✗

✗

on request

BIWI owned storage

ARCHIVE

Lagoon

via itet-stor

lagoon

BeeGFS Client
SMB

private (mid term) archive modifiable

✓

(✓)

on request

Backup for disaster recovery only

LTS

/lts/<inst>lts

ID

NFS
or
SMB

long term archive invariant data

✗

✗

on request

Special LTS user needed
Two copies -> geographical redundancy

* For storage without backup: Make sure to backup stored data yourself!

** For the scratch cleaner's documentation see man scratch_clean

*** Where 'temporary' means, data can be reproduced easily. Or in other words, data is gone, no problem, wasn't so important, can be reproduced.

Services/StorageOverview (last edited 2024-09-26 08:21:49 by hgiger)