Differences between revisions 11 and 28 (spanning 17 versions)
Revision 11 as of 2019-05-14 10:55:58
Size: 44
Editor: mreimers
Comment:
Revision 28 as of 2021-07-13 08:30:56
Size: 3913
Editor: stroth
Comment:
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
{{attachment:storage_overview_600dpi.jpg}} #rev 2020-09-04 davidsch

= Overview of storage classes =

||<rowstyle="font-weight: bold; text-align: center;">Storage Class||Name||Path||Host||NAS||Usage||itet‑stor||Backup||Creation/Access||Remark||
||<|4^>SCRATCH||<^>Scratch||<^>`/scratch(-second`)||<^>local|| ||<^>temp. data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>self service||<^>available on all ISG.EE managed LINUX clients<<BR>>active scratch cleaner*||
||<^>Scratch Net||<^>`/scratch_net`||<^>remote linux client||<^:>NFS||<^>temp. data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>self service||<^>available on dedicated ISG.EE managed LINUX clients<<BR>>active scratch cleaner*||
||<^>[[Services/NetScratch|Net Scratch]]||<^>via [[Workstations/FindYourData|itet-stor]]||<^>itetnas04||<^:>NFS||<^>temp. data, non sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>per default||<^>(scratch cleaner*)||
||<^>Proj Scratch||<^>via [[Workstations/FindYourData|itet-stor]]||<^>itetnas04||<^:>NFS||<^>temp. data + sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>on request||<^>individual setup<<BR>>(scratch cleaner*)||
||<|2^>HOME||<^>[[NewLinuxUser#Where_to_put_your_data|User Home]]||<^>`/home/<user>`||<^>verdi||<^:>NFS<<BR>>SMB||<^>private data, non sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: green; ">✓||<^>per default||<^>||
||<^>Ueb Home||<^>`/home/<ueb>`||<^>tasky||<^:>NFS<<BR>>SMB||<^>ueb specific data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: green; ">✓||<^>on request||<^>No NETHZ/IAM accounts<<BR>>temporary lifetime||
||<|2^>PROJECT||<^>[[Services/ProjectData|Project (Home)]]||<^>`/home/<proj>`<<BR>>via [[Workstations/FindYourData|itet-stor]]||<^>bluebay||<^:>BeeGFS Client<<BR>>SMB||<^>project data + sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: green; ">✓||<^>on request|| ||
||<^>Institute NAS||<^>via [[Workstations/FindYourData|itet-stor]]||<^><inst>nasNN||<^:>NFS<<BR>>SMB||<^>project data + sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: green; ">(✓)||<^>on request||<^>individual setup||
||<:^>SPECIAL||<^>BeeGFS||<style="vertical-align: top; white-space: nowrap;">`/srv/beegfs02/scratch`||<^>benderstor||<^:>BeeGFS Client||<^>temp. compute data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>on request||<^>BIWI owned storage||
||<|2^>ARCHIVE||<^>[[Services/DataArchivingNG|Lagoon]]||<^>via [[Workstations/FindYourData|itet-stor]]||<^>lagoon||<^:>BeeGFS Client<<BR>>SMB||<^>private (mid term) archive modifiable||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: green; ">(✓)||<^>on request||<^>disaster recovery only||
||<^>[[Services/LTSArchiving|LTS]]||<^>`/lts/<inst>lts`||<^>ID||<^:>NFS<<BR>>or<<BR>>SMB||<^>long term archive invariant data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>on request||<^>special LTS user needed<<BR>>2 copies, geographical redundancy||

* For the scratch cleaner's documentation see `man scratch_clean`

##{{attachment:storage_overview_600dpi.jpg}}

Overview of storage classes

Storage Class

Name

Path

Host

NAS

Usage

itet‑stor

Backup

Creation/Access

Remark

SCRATCH

Scratch

/scratch(-second)

local

temp. data

self service

available on all ISG.EE managed LINUX clients
active scratch cleaner*

Scratch Net

/scratch_net

remote linux client

NFS

temp. data

self service

available on dedicated ISG.EE managed LINUX clients
active scratch cleaner*

Net Scratch

via itet-stor

itetnas04

NFS

temp. data, non sharing

per default

(scratch cleaner*)

Proj Scratch

via itet-stor

itetnas04

NFS

temp. data + sharing

on request

individual setup
(scratch cleaner*)

HOME

User Home

/home/<user>

verdi

NFS
SMB

private data, non sharing

per default

Ueb Home

/home/<ueb>

tasky

NFS
SMB

ueb specific data

on request

No NETHZ/IAM accounts
temporary lifetime

PROJECT

Project (Home)

/home/<proj>
via itet-stor

bluebay

BeeGFS Client
SMB

project data + sharing

on request

Institute NAS

via itet-stor

<inst>nasNN

NFS
SMB

project data + sharing

(✓)

on request

individual setup

SPECIAL

BeeGFS

/srv/beegfs02/scratch

benderstor

BeeGFS Client

temp. compute data

on request

BIWI owned storage

ARCHIVE

Lagoon

via itet-stor

lagoon

BeeGFS Client
SMB

private (mid term) archive modifiable

(✓)

on request

disaster recovery only

LTS

/lts/<inst>lts

ID

NFS
or
SMB

long term archive invariant data

on request

special LTS user needed
2 copies, geographical redundancy

* For the scratch cleaner's documentation see man scratch_clean

Services/StorageOverview (last edited 2024-09-26 08:21:49 by hgiger)