Scaling to multiple GPUs

Presenters: Mats Sjöberg (CSC) and Lukas Prediger (CSC)

Content:

• PyTorch DDP on LUMI
• Setting up the experiment as a SLURM batch job
• Setting the correct CPU-GPU bindings

Extra materials

• Hands-on exercises

Q&A

/