Differences between revisions 7 and 42 (spanning 35 versions)
⇤ ← Revision 7 as of 2019-05-14 10:44:52 →
Size: 33
Editor: mreimers
Comment:
← Revision 42 as of 2024-09-24 07:27:22 → ⇥
Size: 4443
Editor: hgiger
Comment:
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
attachment:storage_overview.pdf #rev 2020-09-04 davidsch

= Overview of storage classes =

||<rowstyle="font-weight: bold; text-align: center;">Storage Class||Name||Path||Host||NAS||Usage||itet‑stor||Backup*||Creation/Access||Remark||
||<|4^>SCRATCH||<^>Scratch||<^>`/scratch(-second`)||<^>local|| ||<^>temp. data***||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>self service||<^>available on all ISG D-ITET managed LINUX clients<<BR>>active scratch cleaner**||
||<^>Scratch||<^>`C:\Scratch`)||<^>local|| ||<^>temp. data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>self service||<^>available on all ISG D-ITET managed WINDOWS clients||
||<^>Scratch Net||<^>`/scratch_net`||<^>remote linux client||<^:>NFS||<^>temp. data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>self service||<^>available on dedicated ISG D-ITET managed LINUX clients<<BR>>active scratch cleaner**||
||<^>[[Services/NetScratch|Net Scratch]]||<^>via [[Workstations/FindYourData|itet-stor]]||<^>itetnas04||<^:>NFS||<^>temp. data, non sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>per default||<^>(scratch cleaner**)||
||<^>Proj Scratch||<^>via [[Workstations/FindYourData|itet-stor]]||<^>itetnas04||<^:>NFS||<^>temp. data + sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>on request||<^>individual setup<<BR>>(scratch cleaner**)||
||<|2^>HOME||<^>[[NewLinuxUser#Where_to_put_your_data|User Home]]||<^>`/home/<user>`||<^>verdi||<^:>NFS<<BR>>SMB||<^>private data, non sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: green; ">✓||<^>per default||<^>||
||<^>Ueb Home||<^>`/home/<ueb>`||<^>tasky||<^:>NFS<<BR>>SMB||<^>ueb specific data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: green; ">✓||<^>on request||<^>No NETHZ/IAM accounts<<BR>>temporary lifetime||
||<|2^>PROJECT||<^>[[Services/ProjectData|Project (Home)]]||<^>`/home/<proj>`<<BR>>via [[Workstations/FindYourData|itet-stor]]||<^>bluebay||<^:>BeeGFS Client<<BR>>SMB||<^>project data + sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: green; ">✓||<^>on request|| ||
||<^>Institute NAS||<^>via [[Workstations/FindYourData|itet-stor]]||<^><inst>nasNN||<^:>NFS<<BR>>SMB||<^>project data + sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: green; ">(✓)||<^>on request||<^>individual setup||
||<:^>SPECIAL||<^>BeeGFS||<style="vertical-align: top; white-space: nowrap;">`/srv/beegfs02/scratch`||<^>benderstor||<^:>BeeGFS Client||<^>temp. compute data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>on request||<^>BIWI owned storage||
||<|2^>ARCHIVE||<^>[[Services/DataArchivingNG|Lagoon]]||<^>via [[Workstations/FindYourData|itet-stor]]||<^>lagoon||<^:>BeeGFS Client<<BR>>SMB||<^>private (mid term) archive modifiable||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: green; ">(✓)||<^>on request||<^>backup for disaster recovery only||
||<^>[[Services/LTSArchiving|LTS]]||<^>`/lts/<inst>lts`||<^>ID||<^:>NFS<<BR>>or<<BR>>SMB||<^>long term archive invariant data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>on request||<^>special LTS user needed<<BR>>2 copies, geographical redundancy||

* '''For storage without backup: Make sure to backup stored data yourself!'''

** For the scratch cleaner's documentation see `man scratch_clean`

*** Where 'temporary' means, data can be reproduced easily. Or in other words, data is gone, no problem, wasn't so important, can be reproduced.


##{{attachment:storage_overview_600dpi.jpg}}

Overview of storage classes

Storage Class

Name

Path

Host

NAS

Usage

itet‑stor

Backup*

Creation/Access

Remark

SCRATCH

Scratch

/scratch(-second)

local

temp. data***

✗

✗

self service

available on all ISG D-ITET managed LINUX clients
active scratch cleaner**

Scratch

C:\Scratch)

local

temp. data

✗

✗

self service

available on all ISG D-ITET managed WINDOWS clients

Scratch Net

/scratch_net

remote linux client

NFS

temp. data

✗

✗

self service

available on dedicated ISG D-ITET managed LINUX clients
active scratch cleaner**

Net Scratch

via itet-stor

itetnas04

NFS

temp. data, non sharing

✓

✗

per default

(scratch cleaner**)

Proj Scratch

via itet-stor

itetnas04

NFS

temp. data + sharing

✓

✗

on request

individual setup
(scratch cleaner**)

HOME

User Home

/home/<user>

verdi

NFS
SMB

private data, non sharing

✓

✓

per default

Ueb Home

/home/<ueb>

tasky

NFS
SMB

ueb specific data

✗

✓

on request

No NETHZ/IAM accounts
temporary lifetime

PROJECT

Project (Home)

/home/<proj>
via itet-stor

bluebay

BeeGFS Client
SMB

project data + sharing

✓

✓

on request

Institute NAS

via itet-stor

<inst>nasNN

NFS
SMB

project data + sharing

✓

(✓)

on request

individual setup

SPECIAL

BeeGFS

/srv/beegfs02/scratch

benderstor

BeeGFS Client

temp. compute data

✗

✗

on request

BIWI owned storage

ARCHIVE

Lagoon

via itet-stor

lagoon

BeeGFS Client
SMB

private (mid term) archive modifiable

✓

(✓)

on request

backup for disaster recovery only

LTS

/lts/<inst>lts

ID

NFS
or
SMB

long term archive invariant data

✗

✗

on request

special LTS user needed
2 copies, geographical redundancy

* For storage without backup: Make sure to backup stored data yourself!

** For the scratch cleaner's documentation see man scratch_clean

*** Where 'temporary' means, data can be reproduced easily. Or in other words, data is gone, no problem, wasn't so important, can be reproduced.

Services/StorageOverview (last edited 2024-09-26 08:21:49 by hgiger)