|
Size: 4926
Comment:
|
Size: 4986
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 32: | Line 32: |
| ||IBT ||J. Vörös ||P&S: Controlling Biological Neuronal Networks Using Machine Learning||227-0085-38L||HS || || | ||IBT ||J. Vörös ||P&S: Controlling Biological Neuronal Networks Using Machine Learning||227-0085-38L||HS ||60 || |
| Line 79: | Line 79: |
| * all resources are availabe to all courses, fairly shared by usage * if course booked gpu.interactive, interactive jobs may run there |
* gpu.normal is availabe to all courses * gpu.interactive is available only when booked by a course * Resources are shared fairly based on usage * Usage accounting is reset on a weekly basis |
Slurm Student Course Cluster "Snowflake"
This is the landing page for the Slurm cluster Snowflake, which will be available for official student courses at the beginning of the spring semester 2024.
Complete content will be ready in time.
Contents
Snowflake Slurm cluster
The Snowflake Slurm cluster is reserved and availabe only for official student courses
The following information is an addendum to the main Slurm article in this wiki specific for usage of the Snowflake cluster. Consult the main Slurm article if the information you're looking for isn't available here:
Course information
Courses with access
The following table shows courses which are currently registered to access the Snowflake cluster:
Institute |
Lecturer |
Course |
No |
Semester |
# Students |
CVL |
E. Konukoglu, E. Erdil, M. A. Reyes Aguirre |
Medical Image Analysis |
227-0391-00L |
FS |
90 |
CVL |
C. Sakaridis |
Computer Vision and Artificial Intelligence for Autonomous Cars |
227-0560-00L |
HS |
90 |
CVL |
F. Yu |
Robot Learning |
227-0562-00L |
FS |
30 |
CVL |
L. Van Gool |
P&S: Deep Learning for Image Manipulation (DLIM) |
227-0085-11L |
HS |
15 |
IBT |
J. Vörös |
P&S: Controlling Biological Neuronal Networks Using Machine Learning |
227-0085-38L |
HS |
60 |
TIK |
R. Wattenhofer |
P&S: Hands-On Deep Learning |
227-0085-59L |
FS+HS |
40 |
No: Details of courses are listed in the ETH course catalogue
Requesting course accounts
Course accounts have to be requested with enough time for preparation, from ISG's side and the course coordinator's side. Factor in time to test a course setup after accounts have been set up.
Latest 4 weeks before course begin, course coordinators have to hand in a request for course accounts containing the following information:
- Amount of course accounts needed
Whether course accounts need access to net_scratch or a ISG managed institute NAS (those are mutually exclusive)
- Quota (available disk space) per account. The default is 2 GB, maximum is 10 GB.
- Whether a master account to provide course data to students is needed
At which date course account contents may be deleted (latest possible date: End of examn session of the semester the course takes place
Does the course primarily need interactive (shell access to 1 GPU for up to 4h) or batch jobs (running submitted scripts for up to 24h)?
Notes:
- Course coordinators will receive the list of course account passwords for distribution to course participants
- Course coordinators are responsible to keep a list mapping course participant names to course accounts
Cluster information
Access prerequisites
- user-account member of a slurm account
- isg managed pc (tardis, institute, login)
Setting environment
The environment variable SLURM_CONF needs to be set to point to the configuration of the Snowflake cluster:
export SLURM_CONF=/home/sladmsnow/slurm/slurm.conf
Hardware
Server |
CPU |
Frequency |
Physical cores |
Logical processors |
Memory |
/scratch SSD |
/scratch Size |
GPUs |
Operating System |
snowflake[01-09] |
Intel Xeon Gold 6240 |
2.60 GHz |
36 |
36 |
376 GB |
✓ |
1.8 TB |
8 GeForce RTX 2080 Ti (11 GB) |
Debian 11 |
Partitions
Name |
Function |
Runtime |
gpu.normal |
batch/interactive jobs |
24/4h |
gpu.interactive |
interactive jobs only |
8h |
- example partition/node info command
Fair share
- gpu.normal is availabe to all courses
- gpu.interactive is available only when booked by a course
- Resources are shared fairly based on usage
- Usage accounting is reset on a weekly basis
Slurm account check
- which accounts do exist
- which account do I have (gpu.interactive?)