Moving your HPC workloads to LUMI¶
Course organisation¶
-
Location: University of Copenhagen, Panum and Mærsk Tower, Blegdamsvej 3B, 2200 Copenhagen, Denmark, Room Panum - 13.1.83.
-
Please ask questions only about the current lecture, or possibly past lectures, but not about the material that is yet to come. Ask questions in the section of the current lecture or exercise session as that is the section that is being monitored.
-
Project for the course:
project_465003355.This project provides resources for the exercises. The project should not be used for your own work!
-
There are two Slurm reservations for the course:
- CPU nodes:
lumi-intro-small(on thesmallSlurm partition) - GPU nodes:
lumi-intro-standard_g(on thestandard-gSlurm partition)
- CPU nodes:
Course materials¶
Course materials include the Q&A of each session, slides when available and notes when available. These materials will become available as the course progresses.
| Presentation | slides | notes | recording |
| Day 1 | |||
| Welcome and Introduction | S | / | V |
| Introduction to the course notes | / | N | / |
| Theme: Exploring LUMI from the login nodes | |||
| LUMI Architecture | S | N | V |
| HPE Cray Programming Environment | S | N | V |
| Getting Access to LUMI | S | N | V |
| Exercises 1 | / | / | / |
| Modules on LUMI | S | N | V |
| Exercises 2 | / | / | / |
| LUMI Software Stacks | S | N | V |
| Exercises 3 | / | / | / |
| LUMI Support and Documentation | S | N | V |
| Wrap-Up Day 1 | S | / | V |
| Day 2 | |||
| Introduction Day 2 | S | / | V |
| Theme: Running jobs efficiently | |||
| Slurm on LUMI | S | (N) | V |
| Process and Thread Distribution and Binding | S | (N) | V |
| Exercises 4 | / | / | / |
| Theme: Data on LUMI | |||
| Using Lustre | S | N | V |
| Object Storage | S | N | V |
| Exercises 5 | / | / | / |
| Theme: Containers on LUMI | |||
| Containers on LUMI-C and LUMI-G | S | N | V |
| Wrap-Up Day 2 | S | / | V |
| Appendices | |||
| A1 Additional documentation | / | N | / |
Setting up for the exercises¶
During the course, you can use the training project project_465003355 for the exercises.
After the course, it is still possible to make almost all exercises in your own project.
They need only very little resources, but you will need both CPU and GPU resources.
This project should only be used for exercises and not for your own work!
The "Object Storage" exercises in Exercise session 5 do require data in the training project, so these exercises should really be made while the training project is still active. There is an alternative set of exercises missing only one element from the during-the-course version that can be made in your own project. For the exercises from Exercise session 4 you can no longer use the reservation if they are not made during the second course day (the reservation expires at 5pm CET/ 6pm EET that day).
-
Create a directory in the scratch of your project, or if you want to keep the exercises around for a while, in a subdirectory of your project directory or in your home directory (though we don't recommend the latter). Then go into that directory.
E.g., in the scratch directory of your project:
mkdir -p /scratch/project_46YXXXXXX/course-20261109-$USER/Exercises cd /scratch/project_46YXXXXXX/course-20261109-$USER/Exerciseswhere you have to replace
project_46YXXXXXXusing the number of your own project.If you have no other project on LUMI, you can also use the scratch of the course project
project_465003355. Do use a personal subdirectory as in the following commands:mkdir -p /scratch/project_465003355/$USER/Exercises cd /scratch/project_465003355/$USER/Exercises -
In that directory, untar the exercises:
tar -xf /scratch/project_465003355/exercises-20261109.tar.bz2Alternatively (or if the file would be missing), download the exercises and un-tar:
wget https://462000265.lumidata.eu/2day-20261109/files/exercises-20261109.tar.bz2 tar -xf exercises-20261109.tar.bz2Link to the tar-file with the exercises and the bzip2-compressed version.
-
You're all set to go!
Web links¶
-
LUMI documentation
-
Other course materials
Acknowledgement¶
Though a LUST course, the course borrows a lot of material from a similar course prepared by the Belgian local organisation, which in turn was prepared in the framework of the VSC Tier-0 support activities. The VSC is funded by FWO - Fonds Wetenschappelijk Onderzoek - Vlaanderen (or Research Foundation – Flanders).