EESSI - EUROPEAN ENVIRONMENT FOR SCIENTIFIC SOFTWARE INSTALLATIONS
The main goal of this project is the preparation and building of a commonly used software stack on HPC infrastructure and beyond. The project of EESSI is available on HPC Vega for all users via CernVM-FS.
Production EESSI repository
Initialisation of modules:
source /cvmfs/software.eessi.io/versions/2023.06/init/bash
Output:
Found EESSI repo @ /cvmfs/software.eessi.io/versions/2023.06!
archdetect says x86_64/amd/zen2
Using x86_64/amd/zen2 as software subdirectory.
Using /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen2/modules/all as the directory to be added to MODULEPATH.
Found Lmod configuration file at /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen2/.lmod/lmodrc.lua
Initializing Lmod...
Prepending /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen2/modules/all to $MODULEPATH...
Environment set up to use EESSI (2023.06), have fun!
List available modules:
{EESSI 2023.06} [teop@vglogin0008 ~]$ module av
-------------------------- /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen2/modules/all --------------------------
Abseil/20230125.3-GCCcore-12.3.0 (D) libpng/1.6.39-GCCcore-12.3.0
ALL/0.9.2-foss-2023a libpng/1.6.40-GCCcore-13.2.0 (D)
at-spi2-core/2.49.91-GCCcore-12.3.0 (D) libsodium/1.0.18-GCCcore-12.3.0
Bazel/6.3.1-GCCcore-12.3.0 (D) LibTIFF/4.5.0-GCCcore-12.3.0
BeautifulSoup/4.12.2-GCCcore-12.3.0 LibTIFF/4.6.0-GCCcore-13.2.0 (D)
Bison/3.8.2-GCCcore-12.2.0 libunwind/1.6.2-GCCcore-12.2.0
Bison/3.8.2-GCCcore-12.3.0 libunwind/1.6.2-GCCcore-12.3.0 (D)
Bison/3.8.2-GCCcore-13.2.0 libxml2/2.10.3-GCCcore-12.2.0
BLIS/0.9.0-GCC-12.2.0 libxml2/2.11.4-GCCcore-12.3.0
BLIS/0.9.0-GCC-12.3.0 libxml2/2.11.5-GCCcore-13.2.0 (D)
BLIS/0.9.0-GCC-13.2.0 (D) libxslt/1.1.38-GCCcore-12.3.0 (D)
Boost.MPI/1.82.0-gompi-2023a LLVM/15.0.5-GCCcore-12.2.0
Boost/1.82.0-GCC-12.3.0 (D) LLVM/16.0.6-GCCcore-12.3.0 (D)
Brotli/1.0.9-GCCcore-12.2.0 LoopTools/2.15-GCC-12.3.0
Leaving the environment:
{EESSI 2023.06} [teop@vglogin0008 ~]$ exit
logout
## EESSI GPU support
NVIDIA Drivers are exposed for EESSI GPU support. Modules are tagged with 'gpu' and could be tested as:
{EESSI 2023.06} [teop@vglogin0008 ~]# module load CUDA-Samples {EESSI 2023.06} [teop@vglogin0008 ~]# deviceQuery
deviceQuery Starting...
CUDA Device Query (Runtime API) version (CUDART static linking)
Detected 1 CUDA Capable device(s)
Device 0: "NVIDIA A100-PCIE-40GB" CUDA Driver Version / Runtime Version 12.7 / 12.1 CUDA Capability Major/Minor version number: 8.0 Total amount of global memory: 40444 MBytes (42409000960 bytes) (108) Multiprocessors, (064) CUDA Cores/MP: 6912 CUDA Cores GPU Max Clock rate: 1410 MHz (1.41 GHz) Memory Clock rate: 1215 Mhz Memory Bus Width: 5120-bit L2 Cache Size: 41943040 bytes Maximum Texture Dimension Size (x,y,z) 1D=(131072), 2D=(131072, 65536), 3D=(16384, 16384, 16384) Maximum Layered 1D Texture Size, (num) layers 1D=(32768), 2048 layers Maximum Layered 2D Texture Size, (num) layers 2D=(32768, 32768), 2048 layers Total amount of constant memory: 65536 bytes Total amount of shared memory per block: 49152 bytes Total shared memory per multiprocessor: 167936 bytes Total number of registers available per block: 65536 Warp size: 32 Maximum number of threads per multiprocessor: 2048 Maximum number of threads per block: 1024 Max dimension size of a thread block (x,y,z): (1024, 1024, 64) Max dimension size of a grid size (x,y,z): (2147483647, 65535, 65535) Maximum memory pitch: 2147483647 bytes Texture alignment: 512 bytes Concurrent copy and kernel execution: Yes with 3 copy engine(s) Run time limit on kernels: No Integrated GPU sharing Host Memory: No Support host page-locked memory mapping: Yes Alignment requirement for Surfaces: Yes Device has ECC support: Enabled Device supports Unified Addressing (UVA): Yes Device supports Managed Memory: Yes Device supports Compute Preemption: Yes Supports Cooperative Kernel Launch: Yes Supports MultiDevice Co-op Kernel Launch: Yes Device PCI Domain ID / Bus ID / location ID: 0 / 39 / 0 Compute Mode: < Default (multiple host threads can use ::cudaSetDevice() with device simultaneously) >
deviceQuery, CUDA Driver = CUDART, CUDA Driver Version = 12.7, CUDA Runtime Version = 12.1, NumDevs = 1 Result = PASS
Leaving the environment:
{EESSI 2023.06} [teop@vglogin0008 ~]$ exit logout
## Pilot EESSI repository
!!! note "This isn't recommended for production!"
Initialisation of pilot modules:
source /cvmfs/pilot.eessi-hpc.org/latest/init/bash
Output:
Found EESSI pilot repo @ /cvmfs/pilot.eessi-hpc.org/versions/2021.12! archspec says x86_64/amd/zen2 Using x86_64/amd/zen2 as software subdirectory. Using /cvmfs/pilot.eessi-hpc.org/versions/2021.12/software/linux/x86_64/amd/zen2/modules/all as the directory to be added to MODULEPATH. Found Lmod configuration file at /cvmfs/pilot.eessi-hpc.org/versions/2021.12/software/linux/x86_64/amd/zen2/.lmod/lmodrc.lua Initializing Lmod... Prepending /cvmfs/pilot.eessi-hpc.org/versions/2021.12/software/linux/x86_64/amd/zen2/modules/all to $MODULEPATH... Environment set up to use EESSI pilot software stack, have fun!
List available modules:
[EESSI pilot 2021.12] [teop@vglogin0008 ~]$ module av
------------------------- /cvmfs/pilot.eessi-hpc.org/versions/2021.12/software/linux/x86_64/amd/zen2/modules/all ------------------------- ant/1.10.8-Java-11 LittleCMS/2.9-GCCcore-9.3.0 Arrow/0.17.1-foss-2020a-Python-3.8.2 LittleCMS/2.12-GCCcore-10.3.0 (D) Bazel/3.6.0-GCCcore-9.3.0 LLVM/9.0.1-GCCcore-9.3.0 Bison/3.5.3-GCCcore-9.3.0 LLVM/11.1.0-GCCcore-10.3.0 Bison/3.7.6-GCCcore-10.3.0 LMDB/0.9.24-GCCcore-9.3.0 Boost/1.72.0-gompi-2020a lz4/1.9.2-GCCcore-9.3.0 Boost/1.76.0-GCC-10.3.0 lz4/1.9.3-GCCcore-10.3.0 Brotli/1.0.9-GCCcore-10.3.0 Mako/1.1.2-GCCcore-9.3.0 cairo/1.16.0-GCCcore-9.3.0 Mako/1.1.4-GCCcore-10.3.0 cairo/1.16.0-GCCcore-10.3.0 MariaDB-connector-c/3.1.7-GCCcore-9.3.0 CGAL/4.14.3-gompi-2020a-Python-3.8.2 matplotlib/3.2.1-foss-2020a-Python-3.8.2 CGAL/4.14.3-gompi-2021a Mesa/20.0.2-GCCcore-9.3.0 CMake/3.16.4-GCCcore-9.3.0 Mesa/21.1.1-GCCcore-10.3.0 CMake/3.20.1-GCCcore-10.3.0 Meson/0.55.1-GCCcore-9.3.0-Python-3.8.2 code-server/3.7.3 Meson/0.58.0-GCCcore-10.3.0 DB/18.1.32-GCCcore-9.3.0 METIS/5.1.0-GCCcore-9.3.0 DB/18.1.40-GCCcore-10.3.0 METIS/5.1.0-GCCcore-10.3.0 double-conversion/3.1.5-GCCcore-9.3.0 MPFR/4.0.2-GCCcore-9.3.0 ...
Leaving the environment:
[EESSI pilot 2021.12] [teop@vglogin0008 ~]$ Exit ```
Project documentation: EESSI