Other UW HPC for DiRAC

Hyak Klone

Through the Astronomy Department, DiRAC has 30 slices of Klone distributed between cpu-g2, cpu-g2-mem2x, and compute-bigmem type nodes. Checkpoint resources are available on Klone as well to astro users.

To be added to the astro departmental group e-mail one (or all) of ajc26@uw.edu (Andy Connolly), jrad@uw.edu (Jim Davenport) or mjuric@uw.edu (Mario Juric). Specify the NetID, who they’re working with, and a brief explanation (1 sentence) of why access is needed.

Warning

Klone is known to have a slow filesystem. Only around 4000 IOPS can be sustained across all users at the University. Packing your conda environment or research data into a small number of large files is preferable. Compressing these directories of small files and copying them to/from the node’s local filesystem in your slurm script will help, as will containerizing your job using apptainer/singularity or ngc

At the moment there is no high-bandwidth communication channel for files between Hyak and Middle Earth, your best bet is rsync. Hyak currently has globus connectivity, but Middle Earth does not.

Hyak Tillicum

Tillicum offers GPUs for $0.90/ GPU hr. DiRAC institute has an account which is accessible by emailing ajc26@uw.edu (Andy Connolly) with your UW NetID and a short rationale for why access is needed.

The DiRAC account has a hard usage cap of $1000/mo account-wide and soft usage caps of $200/mo on each account. Current settings can be checked with the hyakusage command

Note

If you need to get in touch directly with Hyak admins, you can use the Research computing club Slack, Office hours, or file a ticket thorugh help@uw.edu with “Hyak” in the subject line

Epyc

Epyc is the legacy compute system which Middle Earth is superceding. An overview of Epyc’s capabilities is available here.