Differences between revisions 29 and 53 (spanning 24 versions)
⇤ ← Revision 29 as of 2023-10-16 13:35:47 →
Size: 3921
Editor: alders
Comment:
← Revision 53 as of 2024-09-26 08:21:49 → ⇥
Size: 4538
Editor: hgiger
Comment:
Deletions are marked like this. Additions are marked like this.
Line 5: Line 5:
||<rowstyle="font-weight: bold; text-align: center;">Storage Class||Name||Path||Host||NAS||Usage||itet‑stor||Backup||Creation/Access||Remark||
||<|4^>SCRATCH||<^>Scratch||<^>`/scratch(-second`)||<^>local|| ||<^>temp. data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>self service||<^>available on all ISG D-ITET managed LINUX clients<<BR>>active scratch cleaner*||
||<^>Scratch Net||<^>`/scratch_net`||<^>remote linux client||<^:>NFS||<^>temp. data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>self service||<^>available on dedicated ISG D-ITET managed LINUX clients<<BR>>active scratch cleaner*||
||<^>[[Services/NetScratch|Net Scratch]]||<^>via [[Workstations/FindYourData|itet-stor]]||<^>itetnas04||<^:>NFS||<^>temp. data, non sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>per default||<^>(scratch cleaner*)||
||<^>Proj Scratch||<^>via [[Workstations/FindYourData|itet-stor]]||<^>itetnas04||<^:>NFS||<^>temp. data + sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>on request||<^>individual setup<<BR>>(scratch cleaner*)||		 ||<rowstyle="font-weight: bold; text-align: center;">Storage Class||Name||Path||Host||NAS||Usage||itet‑stor||Backup*||Creation/Access||Remark||
||<|5^>SCRATCH||<^>Scratch||<^>`/scratch(-second`)||<^>local|| ||<^>temp. data***||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>self service||<^>Available on all ISG D-ITET managed LINUX clients<<BR>>(active scratch cleaner**)||
||<^>Scratch||<^>`C:\Scratch`||<^>local|| ||<^>temp. data***||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>self service||<^>Available on all ISG D-ITET managed WINDOWS clients||
||<^>Scratch Net||<^>`/scratch_net`||<^>remote linux client||<^:>NFS||<^>temp. data***||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>self service||<^> Composition of local harddisks, available on dedicated ISG D-ITET managed LINUX clients<<BR>>(active scratch cleaner**)||
||<^>[[Services/NetScratch|Net Scratch]]||<^>via [[Workstations/FindYourData|itet-stor]]||<^>itetnas04||<^:>NFS||<^>temp. data***, non sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>per default||<^>(scratch cleaner**)||
||<^>Proj Scratch||<^>via [[Workstations/FindYourData|itet-stor]]||<^>itetnas04||<^:>NFS||<^>temp. data*** + sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>on request||<^>Individual setup<<BR>>(scratch cleaner**)||
Line 11: Line 12:
||<^>Ueb Home||<^>`/home/<ueb>`||<^>tasky||<^:>NFS<<BR>>SMB||<^>ueb specific data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: green; ">✓||<^>on request||<^>No NETHZ/IAM accounts<<BR>>temporary lifetime|| ||<^>Ueb Home||<^>`/home/<ueb>`||<^>tasky||<^:>NFS<<BR>>SMB||<^>ueb specific data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: green; ">✓||<^>on request||<^>No NETHZ/IAM accounts<<BR>>Temporary lifetime||
Line 13: Line 14:
||<^>Institute NAS||<^>via [[Workstations/FindYourData|itet-stor]]||<^><inst>nasNN||<^:>NFS<<BR>>SMB||<^>project data + sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: green; ">(✓)||<^>on request||<^>individual setup||
||<:^>SPECIAL||<^>BeeGFS||<style="vertical-align: top; white-space: nowrap;">`/srv/beegfs02/scratch`||<^>benderstor||<^:>BeeGFS Client||<^>temp.  compute data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>on request||<^>BIWI owned storage||
||<|2^>ARCHIVE||<^>[[Services/DataArchivingNG|Lagoon]]||<^>via [[Workstations/FindYourData|itet-stor]]||<^>lagoon||<^:>BeeGFS Client<<BR>>SMB||<^>private (mid term) archive modifiable||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: green; ">(✓)||<^>on request||<^>disaster recovery only||
||<^>[[Services/LTSArchiving|LTS]]||<^>`/lts/<inst>lts`||<^>ID||<^:>NFS<<BR>>or<<BR>>SMB||<^>long term archive invariant data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>on request||<^>special LTS user needed<<BR>>2 copies, geographical redundancy||		 ||<^>Institute NAS||<^>via [[Workstations/FindYourData|itet-stor]]||<^><inst>nasNN||<^:>NFS<<BR>>SMB||<^>project data + sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: green; ">(✓)||<^>on request||<^>Individual setup||
||<:^>SPECIAL||<^>BeeGFS||<style="vertical-align: top; white-space: nowrap;">`/srv/beegfs02/scratch`||<^>benderstor||<^:>BeeGFS Client||<^>temp.*** compute data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>on request||<^>BIWI owned storage||
||<|2^>ARCHIVE||<^>[[Services/DataArchivingNG|Lagoon]]||<^>via [[Workstations/FindYourData|itet-stor]]||<^>lagoon||<^:>BeeGFS Client<<BR>>SMB||<^>private (mid term) archive modifiable||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: green; ">(✓)||<^>on request||<^>Backup for disaster recovery only||
||<^>[[Services/LTSArchiving|LTS]]||<^>`/lts/<inst>lts`||<^>ID||<^:>NFS<<BR>>or<<BR>>SMB||<^>long term archive invariant data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>on request||<^>Special LTS user is needed for access <<BR>> Two copies of data exists, geo-redundant on two ETH locations ||
Line 18: Line 19:
* For the scratch cleaner's documentation see `man scratch_clean` * '''For storage without backup: Make sure to backup stored data yourself!'''

** For the scratch cleaner's documentation see `man scratch_clean`

*** Where 'temporary' means, data can be reproduced easily. Or in other words, data is gone, no problem, wasn't so important, can be reproduced.

Overview of storage classes

Storage Class

Name

Path

Host

NAS

Usage

itet‑stor

Backup*

Creation/Access

Remark

SCRATCH

Scratch

/scratch(-second)

local

temp. data***

✗

✗

self service

Available on all ISG D-ITET managed LINUX clients
(active scratch cleaner**)

Scratch

C:\Scratch

local

temp. data***

✗

✗

self service

Available on all ISG D-ITET managed WINDOWS clients

Scratch Net

/scratch_net

remote linux client

NFS

temp. data***

✗

✗

self service

Composition of local harddisks, available on dedicated ISG D-ITET managed LINUX clients
(active scratch cleaner**)

Net Scratch

via itet-stor

itetnas04

NFS

temp. data***, non sharing

✓

✗

per default

(scratch cleaner**)

Proj Scratch

via itet-stor

itetnas04

NFS

temp. data*** + sharing

✓

✗

on request

Individual setup
(scratch cleaner**)

HOME

User Home

/home/<user>

verdi

NFS
SMB

private data, non sharing

✓

✓

per default

Ueb Home

/home/<ueb>

tasky

NFS
SMB

ueb specific data

✗

✓

on request

No NETHZ/IAM accounts
Temporary lifetime

PROJECT

Project (Home)

/home/<proj>
via itet-stor

bluebay

BeeGFS Client
SMB

project data + sharing

✓

✓

on request

Institute NAS

via itet-stor

<inst>nasNN

NFS
SMB

project data + sharing

✓

(✓)

on request

Individual setup

SPECIAL

BeeGFS

/srv/beegfs02/scratch

benderstor

BeeGFS Client

temp.*** compute data

✗

✗

on request

BIWI owned storage

ARCHIVE

Lagoon

via itet-stor

lagoon

BeeGFS Client
SMB

private (mid term) archive modifiable

✓

(✓)

on request

Backup for disaster recovery only

LTS

/lts/<inst>lts

ID

NFS
or
SMB

long term archive invariant data

✗

✗

on request

Special LTS user is needed for access
Two copies of data exists, geo-redundant on two ETH locations

* For storage without backup: Make sure to backup stored data yourself!

** For the scratch cleaner's documentation see man scratch_clean

*** Where 'temporary' means, data can be reproduced easily. Or in other words, data is gone, no problem, wasn't so important, can be reproduced.

Services/StorageOverview (last edited 2024-09-26 08:21:49 by hgiger)