Available Toolchains and Toolchain Compatibility: Difference between revisions
No edit summary |
|||
Line 66: | Line 66: | ||
==Toolchain compatibility== | ==Toolchain compatibility== | ||
* Software modules built by EasyBuild generally have names in a format like '''Name/Version-Toolchain'''. When you load more than one software module built by EasyBuild, please make sure that all modules are built with '''the same or compatible toolchains'''. You can check this by looking into software modules' names. If | * Software modules built by EasyBuild generally have names in a format like '''Name/Version-Toolchain'''. When you load more than one software module built by EasyBuild, please make sure that all modules are built with '''the same or compatible toolchains'''. You can check this by looking into software modules' names. If you load more than one module and some toolchains are incompatible, you will end up with failing dependencies of Lmod errors, like this: | ||
<pre class="gscript"> | <pre class="gscript"> |
Revision as of 11:15, 28 August 2020
This page is being written in preparation for switching the queueing system on Sapelo2 to Slurm, it is not applicable to Sapelo2 yet.
This page is applicable to the Slurm development cluster (Sap2test)
We use EasyBuild to build most of the software modules on the Sapelo2 cluster. Easybuild is a software build and installation framework that allows us to manage scientific software on High Performance Computing (HPC) systems in an efficient way. EasyBuild employs so-called compiler toolchains or, simply toolchains for short, in handling the build and installation processes. A typical toolchain consists of one or more compilers, usually put together with some libraries for specific functionality, e.g., for using an MPI stack for distributed computing, or which provide optimized routines for commonly used math operations, e.g., the well-known BLAS/LAPACK APIs for linear algebra routines. For detailed info about EasyBuild and its toolchains, please refer to EasyBuild and toolchains
Available toolchains on cluster
- Common compiler toolchains on the Sapelo2 cluster:
Name | Version | Compiler(s) | MPI library | Linear algebra library | FFT |
---|---|---|---|---|---|
foss | 2019b | GCC/8.3.0 | OpenMPI/3.1.4 | OpenBLAS/0.3.7, ScaLAPACK/2.0.2 | FFT/3.3.8 |
gompi | 2019b | GCC/8.3.0 | OpenMPI/3.1.4 | ||
GCC | 6.4.0-2.28, 8.3.0, 9.2.0 | GCC | |||
GCCcore | 6.4.0, 8.3.0, 9.2.0 | GCCcore |
- Compiler toolchains with GPU/CUDA support on the Sapelo2 cluster:
Name | Version | Compiler(s) | MPI library | Linear algebra library | FFT |
---|---|---|---|---|---|
fosscuda | 2019b | GCC/8.3.0, CUDA/10.1.243 | OpenMPI/3.1.4 | OpenBLAS/0.3.7, ScaLAPACK/2.0.2 | FFT/3.3.8 |
gompic | 2019b | GCC/8.3.0, CUDA/10.1.243 | OpenMPI/3.1.4 | ||
gcccuda | 2019b | GCC/8.3.0, CUDA/10.1.243 |
For a complete list of EasyBuild toolchains, please refer to List_of_known_toolchains
Toolchain compatibility
- Software modules built by EasyBuild generally have names in a format like Name/Version-Toolchain. When you load more than one software module built by EasyBuild, please make sure that all modules are built with the same or compatible toolchains. You can check this by looking into software modules' names. If you load more than one module and some toolchains are incompatible, you will end up with failing dependencies of Lmod errors, like this:
Lmod has detected the following error: These module(s) exist but cannot be loaded as requested
- Also please note that, when a conflicting module is loaded, one or more dependent modules of the software previously loaded could be replaced, and thus results in the software previously loaded being broken.
- The diagram below shows toolchains belonging to GCC/8.3.0 family. They are all compatible with each other. The blue connection lines with arrows illustrate toolchain build hierarchy, for example, GCC-8.3.0 is built on the top of GCCcore-8.3.0.
Dependency compatibility (to be added)
- The diagram below gives examples showing what will happen when incompatible toolchains and conflicting modules are loaded: