TIK Slurm information

The Computer Engineering and Networks Laboratory (TIK) owns nodes in the Slurm cluster with restricted access. The following information is an addendum to the main Slurm article in this wiki specific for accessing these TIK nodes.
If the information you're looking for isn't available here, please consult the main Slurm article.

Hardware

The following GPU nodes are reserved for exclusive use by TIK:

Shared /scratch_net

Access to local /scratch of each node is available as an automount (on demand) under /scratch_net/tikgpuNM (Replace NM with an existing hostname number) on each node.

• On demand means: The path to a node's /scratch will be available at first access, like after issuing ls /scratch_net/tikgpuNM and disappear again when unused.

• scratch_clean is active on local /scratch of all nodes, meaning older data will be deleted if space is needed. For details see the man page man scratch_clean.

Accounts and partitions

The nodes are grouped in partitions to prioritize access for different accounts:

* Please contact the person vouching for your guest access - or your supervisor if you're a student - and ask them to have you granted account membership

Overflow into gpu.normal

Jobs from TIK users will overflow to partition gpu.normal in case all TIK nodes are busy, as TIK is an institute contributing to the Slurm cluster besides owning nodes.

Dual account membership

Check which accounts you're a member of with the following command:

sacctmgr show users WithAssoc Format=User%-15,DefaultAccount%-15,Account%-15 ${USER}

If you're a member of account tik-external and have also been added to tik-highmem, your default account is the latter and all your jobs will by default be sent to partition tikgpu.all. So when you want to run jobs in partition tikgpu.medium you have to specify the account tik-external as in the following example:

sbatch --account=tik-external job_script.sh

If you already have a PENDING job in the wrong partition you can correct it by issuing the following command:

scontrol update jobid=<job id> partition=tikgpu.medium account=tik-external

Rules of conduct

There are no limits imposed on resources requested by jobs. Please be polite and share available resources sensibly. If you're in need of above-average resources, please coordinate with other TIK Slurm users.

Improving the configuration

If you think the current configuration of TIK nodes, partitions etc. could be improved:

• Discuss your ideas with your team colleagues

• Ask your ID institute support who the current TIK cluster coordinators are

• Bring your suggestions for improvement to the coordinators

The coordinators will streamline your ideas into a concrete change request which we (ISG D-ITET) will implement for you.