Differences between revisions 36 and 51 (spanning 15 versions)
⇤ ← Revision 36 as of 2024-09-24 07:19:08 →
Size: 4500
Editor: hgiger
Comment:
← Revision 51 as of 2024-09-26 07:32:01 → ⇥
Size: 4499
Editor: hgiger
Comment:
Deletions are marked like this. Additions are marked like this.
Line 6: Line 6:
||<|4^>SCRATCH||<^>Scratch||<^>`/scratch(-second`)||<^>local|| ||<^>temp. data***||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>self service||<^>available on all ISG D-ITET managed LINUX clients<<BR>>active scratch cleaner**||

||<|4^>SCRATCH||<^>Scratch||<^>`/scratch(-second`)||<^>local|| ||<^>temp. data***||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>self service||<^>available on all ISG D-ITET managed LINUX clients<<BR>>active scratch cleaner**||


||<^>Scratch Net||<^>`/scratch_net`||<^>remote linux client||<^:>NFS||<^>temp. data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>self service||<^>available on dedicated ISG D-ITET managed LINUX clients<<BR>>active scratch cleaner**||
||<^>[[Services/NetScratch|Net Scratch]]||<^>via [[Workstations/FindYourData|itet-stor]]||<^>itetnas04||<^:>NFS||<^>temp. data, non sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>per default||<^>(scratch cleaner**)||
||<^>Proj Scratch||<^>via [[Workstations/FindYourData|itet-stor]]||<^>itetnas04||<^:>NFS||<^>temp. data + sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>on request||<^>individual setup<<BR>>(scratch cleaner**)||		 ||<|5^>SCRATCH||<^>Scratch||<^>`/scratch(-second`)||<^>local|| ||<^>temp. data***||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>self service||<^>Available on all ISG D-ITET managed LINUX clients<<BR>>(active scratch cleaner**)||
||<^>Scratch||<^>`C:\Scratch`||<^>local|| ||<^>temp. data***||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>self service||<^>Available on all ISG D-ITET managed WINDOWS clients||
||<^>Scratch Net||<^>`/scratch_net`||<^>remote linux client||<^:>NFS||<^>temp. data***||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>self service||<^> Composition of local harddisks, available on dedicated ISG D-ITET managed LINUX clients<<BR>>(active scratch cleaner**)||
||<^>[[Services/NetScratch|Net Scratch]]||<^>via [[Workstations/FindYourData|itet-stor]]||<^>itetnas04||<^:>NFS||<^>temp. data***, non sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>per default||<^>(scratch cleaner**)||
||<^>Proj Scratch||<^>via [[Workstations/FindYourData|itet-stor]]||<^>itetnas04||<^:>NFS||<^>temp. data*** + sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>on request||<^>individual setup<<BR>>(scratch cleaner**)||
Line 17: Line 14:
||<^>Institute NAS||<^>via [[Workstations/FindYourData|itet-stor]]||<^><inst>nasNN||<^:>NFS<<BR>>SMB||<^>project data + sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: green; ">(✓)||<^>on request||<^>individual setup||
||<:^>SPECIAL||<^>BeeGFS||<style="vertical-align: top; white-space: nowrap;">`/srv/beegfs02/scratch`||<^>benderstor||<^:>BeeGFS Client||<^>temp.  compute data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>on request||<^>BIWI owned storage||
||<|2^>ARCHIVE||<^>[[Services/DataArchivingNG|Lagoon]]||<^>via [[Workstations/FindYourData|itet-stor]]||<^>lagoon||<^:>BeeGFS Client<<BR>>SMB||<^>private (mid term) archive modifiable||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: green; ">(✓)||<^>on request||<^>backup for disaster recovery only||
||<^>[[Services/LTSArchiving|LTS]]||<^>`/lts/<inst>lts`||<^>ID||<^:>NFS<<BR>>or<<BR>>SMB||<^>long term archive invariant data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>on request||<^>special LTS user needed<<BR>>2 copies, geographical redundancy||		 ||<^>Institute NAS||<^>via [[Workstations/FindYourData|itet-stor]]||<^><inst>nasNN||<^:>NFS<<BR>>SMB||<^>project data + sharing||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: green; ">(✓)||<^>on request||<^>Individual setup||
||<:^>SPECIAL||<^>BeeGFS||<style="vertical-align: top; white-space: nowrap;">`/srv/beegfs02/scratch`||<^>benderstor||<^:>BeeGFS Client||<^>temp.*** compute data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>on request||<^>BIWI owned storage||
||<|2^>ARCHIVE||<^>[[Services/DataArchivingNG|Lagoon]]||<^>via [[Workstations/FindYourData|itet-stor]]||<^>lagoon||<^:>BeeGFS Client<<BR>>SMB||<^>private (mid term) archive modifiable||<style="vertical-align: top; text-align: center; color: green; ">✓||<style="vertical-align: top; text-align: center; color: green; ">(✓)||<^>on request||<^>Backup for disaster recovery only||
||<^>[[Services/LTSArchiving|LTS]]||<^>`/lts/<inst>lts`||<^>ID||<^:>NFS<<BR>>or<<BR>>SMB||<^>long term archive invariant data||<style="vertical-align: top; text-align: center; color: red; ">✗||<style="vertical-align: top; text-align: center; color: red; ">✗||<^>on request||<^>Special LTS user needed <<BR>> Two copies -> geographical redundancy||

Overview of storage classes

Storage Class

Name

Path

Host

NAS

Usage

itet‑stor

Backup*

Creation/Access

Remark

SCRATCH

Scratch

/scratch(-second)

local

temp. data***

✗

✗

self service

Available on all ISG D-ITET managed LINUX clients
(active scratch cleaner**)

Scratch

C:\Scratch

local

temp. data***

✗

✗

self service

Available on all ISG D-ITET managed WINDOWS clients

Scratch Net

/scratch_net

remote linux client

NFS

temp. data***

✗

✗

self service

Composition of local harddisks, available on dedicated ISG D-ITET managed LINUX clients
(active scratch cleaner**)

Net Scratch

via itet-stor

itetnas04

NFS

temp. data***, non sharing

✓

✗

per default

(scratch cleaner**)

Proj Scratch

via itet-stor

itetnas04

NFS

temp. data*** + sharing

✓

✗

on request

individual setup
(scratch cleaner**)

HOME

User Home

/home/<user>

verdi

NFS
SMB

private data, non sharing

✓

✓

per default

Ueb Home

/home/<ueb>

tasky

NFS
SMB

ueb specific data

✗

✓

on request

No NETHZ/IAM accounts
temporary lifetime

PROJECT

Project (Home)

/home/<proj>
via itet-stor

bluebay

BeeGFS Client
SMB

project data + sharing

✓

✓

on request

Institute NAS

via itet-stor

<inst>nasNN

NFS
SMB

project data + sharing

✓

(✓)

on request

Individual setup

SPECIAL

BeeGFS

/srv/beegfs02/scratch

benderstor

BeeGFS Client

temp.*** compute data

✗

✗

on request

BIWI owned storage

ARCHIVE

Lagoon

via itet-stor

lagoon

BeeGFS Client
SMB

private (mid term) archive modifiable

✓

(✓)

on request

Backup for disaster recovery only

LTS

/lts/<inst>lts

ID

NFS
or
SMB

long term archive invariant data

✗

✗

on request

Special LTS user needed
Two copies -> geographical redundancy

* For storage without backup: Make sure to backup stored data yourself!

** For the scratch cleaner's documentation see man scratch_clean

*** Where 'temporary' means, data can be reproduced easily. Or in other words, data is gone, no problem, wasn't so important, can be reproduced.

Services/StorageOverview (last edited 2024-09-26 08:21:49 by hgiger)