Skip to content

spack‐stack‐1.8.0 release documentation

RatkoVasic-NOAA edited this page Oct 3, 2024 · 25 revisions

Officially supported spack-stack 1.8.0 installations (tier 1)

Note. A link to post-release updates will be provided here when needed.

Ready-to-use spack-stack 1.8.0 installations are available on the following, fully supported platforms. This version supports JEDI-Skylab, various UFS and related applications (UFS Weather Model, EMC Global Workflow, GSI, UFS Short Range Weather Application), and several NEPTUNE applications. Amazon Web Services AMI are available in the US East 1 or 2 regions.

Organization System Compilers Maintainers
HPC platforms
MSU Hercules GCC, Intel EPIC / JCSDA
MSU Orion GCC, Intel EPIC / JCSDA
NASA Discover SCU16 GCC, Intel JCSDA
NASA Discover SCU17 GCC, Intel JCSDA
NCAR-Wyoming Derecho GCC, Intel EPIC / JCSDA
NOAA (NCEP) Acorn Intel NOAA-EMC
NOAA (RDHPCS) Gaea C5 Intel EPIC / NOAA-EMC
NOAA (RDHPCS) Gaea C6 Intel EPIC / NOAA-EMC
NOAA (RDHPCS) Hera GCC, Intel EPIC / NOAA-EMC
NOAA (RDHPCS) Jet GCC, Intel EPIC / NOAA-EMC
U.S. Navy (HPCMP) Narwhal GCC, Intel, oneAPI NRL
U.S. Navy (HPCMP) Nautilus GCC, Intel, oneAPI NRL
Univ. of Wisconsin S4 Intel JCSDA
Cloud platforms
Amazon Web Services AMI Red Hat 8 GCC JCSDA
Amazon Web Services Parallelcluster JCSDA GCC, Intel JCSDA
NOAA (RDHPCS) RDHPCS Parallel Works Intel EPIC / JCSDA

To use one of the above installations via the system default environment module system, follow the instructions in the individual sections below. For questions or problems, please consult the known issues (MISSING LINK TO KNOWN ISSUES BELOW), the currently open GitHub issues, and the GitHub discussions first.

Supplemental environments

The following is a list of supplemental or "add-on" environments that are maintained through spack-stack. These environments are provided on a subset of the tier 1 platforms. To use them, replace ue-COMPILER-VERSION in the instructions below with the add-on environment name.

Environment name Description Platforms
gsi-addon-* Supports GSI and related applications
ne-* Supports NRL's NEPTUNE atmospheric model with xNRL Nautilus, Narwhal
ufswm-* Supports UFS Weather Model with WCOSS2 package versions

Site-specific documentation

MSU Orion

The following is required for using spack to build and run software with any of the compilers below.

module purge

For Intel (classic):

module use /work/noaa/epic/role-epic/spack-stack/orion/spack-stack-1.8.0/envs/ue-intel-2021.9.0/install/modulefiles/Core
module load stack-intel/2021.9.0
module load stack-intel-oneapi-mpi/2021.9.1
module load stack-python/3.11.7

For GNU:

module use /work/noaa/epic/role-epic/spack-stack/orion/spack-stack-1.8.0/envs/ue-gcc-12.2.0/install/modulefiles/Core
module load stack-gcc/12.2.0
module load stack-openmpi/4.1.4
module load stack-python/3.11.7

MSU Hercules

The following is required for using spack to build and run software with any of the compilers below.

module purge

For Intel (classic):

module use /work/noaa/epic/role-epic/spack-stack/hercules/spack-stack-1.8.0/envs/ue-intel-2021.9.0/install/modulefiles/Core
module load stack-intel/2021.9.0
module load stack-intel-oneapi-mpi/2021.9.1
module load stack-python/3.11.7

For GNU:

GNU installation on Hercules is currently failing!

NASA Discover SCU16

The following is required for using spack to build and run software with any of the compilers below.

module purge
module use /discover/swdev/gmao_SIteam/modulefiles-SLES12
module use /discover/swdev/jcsda/spack-stack/scu16/modulefiles
module load miniconda/3.9.7

For Intel:

module use /gpfsm/dswdev/jcsda/spack-stack/scu16/spack-stack-1.8.0/envs/ue-intel-2021.6.0/install/modulefiles/Core
module load stack-intel/2021.6.0
module load stack-intel-oneapi-mpi/2021.6.0
module load stack-python/3.11.7

For GNU:

module use /gpfsm/dswdev/jcsda/spack-stack/scu16/spack-stack-1.8.0/envs/ue-gcc-12.1.0/install/modulefiles/Core
module load stack-gcc/12.1.0
module load stack-openmpi/4.1.3
module load stack-python/3.11.7

NASA Discover SCU17

The following is required for using spack to build and run software with any of the compilers below.

module purge
module use /discover/swdev/gmao_SIteam/modulefiles-SLES15
module use /discover/swdev/jcsda/spack-stack/scu17/modulefiles

For Intel:

module use /gpfsm/dswdev/jcsda/spack-stack/scu17/spack-stack-1.8.0/envs/ue-intel-2021.10.0/install/modulefiles/Core
module load stack-intel/2021.10.0
module load stack-intel-oneapi-mpi/2021.10.0
module load stack-python/3.11.7

For GNU:

module use /gpfsm/dswdev/jcsda/spack-stack/scu17/spack-stack-1.8.0/envs/ue-gcc-12.3.0/install/modulefiles/Core
module load stack-gcc/12.3.0
module load stack-openmpi/4.1.6
module load stack-python/3.11.7

NAVY HPCMP Narwhal

The following is required for using spack to build and run software with Intel. Don't use module purge on Narwhal!

module unload PrgEnv-cray
module load PrgEnv-intel/8.3.3
module unload intel
module load intel-classic/2023.2.0
module unload cray-mpich
module unload craype-network-ofi
module load craype-network-ucx
module load cray-mpich-ucx/8.1.21
module load libfabric/1.12.1.2.2.1
module unload cray-libsci
module load cray-libsci/23.05.1.4

module use /p/app/projects/NEPTUNE/spack-stack/spack-stack-1.8.0/envs/ue-intel-2021.10.0/install/modulefiles/Core
module load stack-intel/2021.10.0
module load stack-cray-mpich/8.1.21
module load stack-python/3.11.7

Experimental and for NEPTUNE standalone environment (ne-) without Python packages only: The following is required for using spack to build and run software with Intel oneAPI. Don't use module purge on Narwhal!

module unload PrgEnv-cray
module load PrgEnv-intel/8.3.3
module unload intel
module use /p/app/projects/NEPTUNE/spack-stack/oneapi-2024.2.1/modulefiles
module load tbb/2021.13
module load compiler-rt/2024.2.1
module load compiler/2024.2.1
module load ifort/2024.2.1
module unload cray-mpich
module unload craype-network-ofi
module load craype-network-ucx
module load cray-mpich-ucx/8.1.21
module load libfabric/1.12.1.2.2.1
module unload cray-libsci
module load cray-libsci/23.05.1.4

module use /p/app/projects/NEPTUNE/spack-stack/spack-stack-1.8.0/envs/ne-oneapi-2024.2.1-no-python/install/modulefiles/Core
module load stack-oneapi/2024.2.1
module load stack-cray-mpich/8.1.21

The following is required for using spack to build and run software with GNU. Don't use module purge on Narwhal!

module unload PrgEnv-cray
module load PrgEnv-gnu/8.3.3
module unload gcc
module load gcc/10.3.0
module unload cray-mpich
module unload craype-network-ofi
module load craype-network-ucx
module load cray-mpich-ucx/8.1.21
module load libfabric/1.12.1.2.2.1
module unload cray-libsci
module load cray-libsci/23.05.1.4

module use /p/app/projects/NEPTUNE/spack-stack/spack-stack-1.8.0/envs/ue-gcc-10.3.0/install/modulefiles/Core
module load stack-gcc/10.3.0
module load stack-cray-mpich/8.1.21
module load stack-python/3.11.7

NAVY HPCMP Nautilus

The following is required for using spack to build and run software with any of the compilers below.

module purge

For Intel classic:

module use /p/app/projects/NEPTUNE/spack-stack/spack-stack-1.8.0/envs/ue-intel-2021.5.0/install/modulefiles/Core
module load stack-intel/2021.5.0
module load stack-openmpi/4.1.6
module load stack-python/3.11.7

For GNU:

module use /p/app/projects/NEPTUNE/spack-stack/spack-stack-1.8.0/envs/ue-gcc-12.2.1/install/modulefiles/Core
module load stack-gcc/12.2.1
module load stack-openmpi/5.0.1
module load stack-python/3.11.7

For Intel oneAPI (LLVM compilers with ifort instead of ifx):

module use /p/app/projects/NEPTUNE/spack-stack/oneapi-2024.2.1/modulefiles
module use /p/app/projects/NEPTUNE/spack-stack/spack-stack-1.8.0/envs/ue-oneapi-2024.2.1/install/modulefiles/Core
module load stack-oneapi/2024.2.1
module load stack-intel-oneapi-mpi/2021.13
module load stack-python/3.11.7

NCAR-Wyoming Derecho

The following is required for using spack to build and run software with any of the compilers below.

module purge
# ignore that the sticky module ncarenv/... is not unloaded
export LMOD_TMOD_FIND_FIRST=yes
module load ncarenv/23.09
module use /glade/work/epicufsrt/contrib/spack-stack/derecho/modulefiles

For Intel (classic):

module use /glade/work/epicufsrt/contrib/spack-stack/derecho/spack-stack-1.8.0/envs/ue-intel-2021.10.0/install/modulefiles/Core
module load stack-intel/2021.10.0
module load stack-cray-mpich/8.1.25
module load stack-python/3.11.7

For GNU:

module use /glade/work/epicufsrt/contrib/spack-stack/derecho/spack-stack-1.8.0/envs/ue-gcc-12.2.0/install/modulefiles/Core
module load stack-gcc/12.2.0
module load stack-cray-mpich/8.1.25
module load stack-python/3.11.7

NOAA Acorn (WCOSS2 test system)

MISSING

NOAA Parallel Works (AWS, Azure, Gcloud)

The following is required for using spack to build and run software with the compiler below.

module purge

For Intel (classic):

module use /contrib/spack-stack-rocky8/spack-stack-1.8.0/envs/ue-intel-2021.10.0/install/modulefiles/Core
module load stack-intel/2021.10.0
module load stack-intel-oneapi-mpi/2021.10.0
module load stack-python/3.11.7

NOAA RDHPCS Gaea - C5

The following is required for using spack to build and run software with the compiler below. Don't use module purge on Gaea - C5!

For Intel classic:

module use /ncrc/proj/epic/spack-stack/spack-stack-1.8.0/envs/ue-intel-2021.9.0/install/modulefiles/Core
module load stack-intel/2023.1.0
module load stack-cray-mpich/8.1.25
module load stack-python/3.11.7

NOAA RDHPCS Gaea - C6

The following is required for using spack to build and run software with the compiler below. Don't use module purge on Gaea - C6!

For Intel classic:

module use /ncrc/proj/epic/spack-stack/c6/spack-stack-1.8.0/envs/ue-intel-2021.10.0/install/modulefiles/Core
module load stack-intel/2023.2.0
module load stack-cray-mpich/8.1.29
module load stack-python/3.11.7

NOAA RDHPCS Hera

The following is required for using spack to build and run software with any of the compilers below.

module purge

For Intel (classic):

module use /contrib/spack-stack/spack-stack-1.8.0/envs/ue-intel-2021.5.0/install/modulefiles/Core
module load stack-intel/2021.5.0
module load stack-intel-oneapi-mpi/2021.5.1
module load stack-python/3.11.7

For GNU:

module use /contrib/spack-stack/spack-stack-1.8.0/envs/ue-gcc-9.2.0/install/modulefiles/Core
module load stack-gcc/9.2.0
module load stack-openmpi/4.1.6
module load stack-python/3.11.7

NOAA RDHPCS Jet

The following is required for using spack to build and run software with any of the compilers below.

module purge

For Intel (classic):

module use /contrib/spack-stack/spack-stack-1.8.0/envs/ue-intel-2021.5.0/install/modulefiles/Core
module load stack-intel/2021.5.0
module load stack-intel-oneapi-mpi/2021.5.1
module load stack-python/3.11.7

For GNU:

module use /contrib/spack-stack/spack-stack-1.8.0/envs/ue-gcc-9.2.0/install/modulefiles/Core
module load stack-gcc/9.2.0
module load stack-openmpi/4.1.6
module load stack-python/3.11.7

UW (Univ. of Wisconsin) S4

MISSING - S4 is currently undergoing a major system upgrade, spack-stack-1.8.0 will be installed after the upgrade is complete.

Amazon Web Services Parallelcluster Ubuntu 20.04

MISSING

Amazon Web Services Red Hat 8

MISSING

Known issues

None at this time.