Extreme-scale AI

Presenters: Samuel Antão (AMD) and Harvey Richardson (HPE)

Content:

• Model parallelism on LUMI via FSDP or DeepSpeed
• Scaling beyond a single node
• Loading training data from Lustre and LUMI-O

Extra materials

• Demo and hands-on exercises

Q&A

/