singularity-AI-bindings
User documentation
What is the module for?
LUMI offers a range of containers mostly for AI applications in /appl/local/containers:
-
Subdirectory
sif-images
: Link to the most recent version of a particular container. -
Subdirectory
tested-containers
: Latest container builds, the content changes all the time. -
Subdirectory
easybuild-sif-images
: Copies of current and former containers fromtested-containers
to keep a more stable repository which is needed for the EasyBuild modules that install containers and offer some extras (see, e.g., the PyTorch container).
These containers use the CXI provider and MPI libraries from the system to guarantee
good performance for network communications through RCCL and MPI (also used by
the Python package mpi4py
). Furthermore, singularity on LUMI by default only gives you
access to your home directory, but not to your data in /project
, /scratch
and
/flash
. This module sets the environment variable SINGULARITY_BIND
which instructs
singularity which files and directories from the system should be made available where
in the container and takes care binding the necessary files for CXI, MPI and full file
system access.
For most of these containers, there are also more complete modules available to ease
working with them that can be installed through EasyBuild, e.g., for most containers
for PyTorch, TensorFlow,
jax, AlphaFold,
rocm and mpi4py. The modules
installed for those containers following the instructions on those pages in the
LUMI Software Library already perform all necessary bindings. So when using these
modules, one should not use singularity-AI-bindings
.
Install
In short, the module can be installed once to be available in all versions of the CrayEnv
and LUMI
stacks:
The long: If you will install more user-installable software from the LUMI Software Library, please check our documentation on installing software with EasyBuild in the LUMI documentation.
User-installable modules (and EasyConfigs)
Install with the EasyBuild-user module:
To access module help after installation and get reminded for which stacks and partitions the module is installed, usemodule spider singularity-AI-bindings/<version>
.
EasyConfig: