Skip to content

Advanced LUMI Training, October 28-31, 2024

Course organisation

  • Location: SURF, Science Park 140, 1098 XG Amsterdam, The Netherlands

  • The public transportation is run by GVB.

    • Whatever type of ticket you have, you always need to check in and check out.

      It is now perfectly possible to do so with your bank card, but of course you should use the same one to check in and check out.

      If you use your bank card, you can use their app Gappie to follow up your use. The app also provides routing, and you can by regular single or multi-day tickets in it that will then work with a QR code.

    • Gappie app for iOS and Gappie app for Android

    • Multi-day tickets are interesting if you take public transportation a lot. You can buy them in the Gappie app, but opening the app and scanning the QR code is a slow process compared to tapping a credit card on the reader. If all travel you need is from a hotel in the centre to the venue and back, it isn't worth it.

  • Amsterdam is more than canals and the red light district. You don't have to drink only water and milk and there is more food than "bitterballen" from the FEBO.

  • Original schedule (PDF)

    Dynamic schedule (adapted as the course progresses)

    The dynamic schedule also contains links to pages with information about the course materials, but those links are also available below on this page.

  • HedgeDoc for questions

  • During the course, there are two Slurm reservations available:

    • CPU nodes: lumic_ams
    • GPU nodes: lumig_ams

    They can be used in conjunction with the training project project_465001362.

    Note that the reservations and course project should only be used for making the exercises during the course and not for running your own jobs. The resources allocated to the course are very limited.

Course materials

Course materials include the Q&A of each session, slides when available and notes when available.

Due to copyright issues some of the materials are only available to current LUMI users and have to be downloaded from LUMI.

Note: Some links in the table below are dead and will remain so until after the end of the course.

Presentation slides notes recording
Introduction / / web
HPE Cray EX Architecture lumi / lumi
Programming Environment and Modules lumi / lumi
Running Applications lumi / lumi
Exercises #1 / / /
Compilers and Parallel Programming Models lumi / lumi
Exercises #2 / / /
Cray Scientific Libraries lumi / lumi
Exercises #3 / / /
CCE Offloading Models lumi / lumi
Advanced Placement lumi / lumi
Exercises #4 / / /
Debugging at Scale lumi / lumi
Exercises #5 / / /
Introduction to the AMD ROCm Ecosystem web / web
Exercises #6 / / /
LUMI Software Stacks web web web
Introduction to Perftools lumi / lumi
Exercises #7 / / /
Advanced Performance Analysis lumi / lumi
Exercises #8 / / /
MPI Topics on the HPE Cray EX Supercomputer lumi / lumi
Exercises #9 / / /
AMD Debugger: ROCgdb web / web
Exercises #10 / / /
Introduction to ROC-Profiler (rocprof) web / web
Exercises #11 / / /
Introduction to Python on Cray EX lumi / lumi
Performance Optimization: Improving single-core Efficiency lumi / lumi
Frameworks for porting applications to GPUs lumi / lumi
Exercises #12 / / /
Optimizing Large Scale I/O lumi / lumi
Exercises #13 / / /
Introduction to OmniTrace web / web
Exercises #14 / / /
Introduction to Omniperf web / web
Exercises #15 / / /
Tools in Action - An Example with Pytorch web / web
LUMI User Support web web web
Appendix: Additional documentation / documentation /

Making the exercises after the course

HPE

The exercise material remains available in the course archive on LUMI:

  • The PDF notes in /appl/local/training/4day-20241028/files/LUMI-4day-20241028-Exercises_HPE.pdf

  • The other files for the exercises in either a bzip2-compressed tar file /appl/local/training/4day-20241028/files/LUMI-4day-20241028-Exercises_HPE.tar.bz2 or an uncompressed tar file /appl/local/training/4day-20241028/files/LUMI-4day-20241028-Exercises_HPE.tar.

To reconstruct the exercise material in your own home, project or scratch directory, all you need to do is run:

tar -xf /appl/local/training/4day-20241028/files/LUMI-4day-20241028-Exercises_HPE.tar.bz2

in the directory where you want to work on the exercises. This will create the Exercises/HPE subdirectory from the training project.

However, instead of running the lumi_c.sh or lumi_g.sh scripts that only work for the course as they set the course project as the active project for Slurm and also set a reservation, use the lumi_c_after.sh and lumi_g_after.sh scripts instead, but first edit them to use one of your projects.

AMD

There are online notes about the AMD exercises. A PDF print-out with less navigation features is also available and is particularly useful should the online notes become unavailable. However, some lines are incomplete. A web backup is also available, but corrections to the original made after the course are not included.

The other files for the exercises are available in either a bzip2-compressed tar file /appl/local/training/4day-20241028/files/LUMI-4day-20241028-Exercises_AMD_.tar.bz2 or an uncompressed tar file /appl/local/training/4day-20241028/files/LUMI-4day-20241028-Exercises_AMD.tar and can also be downloaded. ( bzip2-compressed tar download or uncompressed tar download)

To reconstruct the exercise material in your own home, project or scratch directory, all you need to do is run:

tar -xf /appl/local/training/4day-20241028/files/LUMI-4day-20241028-Exercises_AMD.tar.bz2

in the directory where you want to work on the exercises. This will create the exercises/AMD subdirectory from the training project. You can do so in the same directory where you installed the HPE exercises.

Warning

The software and exercises were tested thoroughly at the time of the course. LUMI however is in continuous evolution and changes to the system may break exercises and software

The links to all documentation mentioned during the talks is on a separate page.

External material for exercises

Some of the exercises used in the course are based on exercises or other material available in various GitHub repositories: