05 Jan 23:17

7b253ba

Version 2.0.0 Latest

Latest

We are pleased to announce the release of version 2.0.0 of spack-stack.

The spack-stack package is a collaborative effort between the NOAA Environmental Modeling Center (EMC), the UCAR Joint Center for Satellite Data Assimilation (JCSDA), the Earth Prediction Innovation Center (EPIC), the United States Naval Research Lab (NRL), and the NASA Global Modeling and Assimilation Office (GMAO). spack-stack is designed to support the various applications of the supporting agencies such as the Unified Forecast System (UFS), the Joint Effort for Data assimilation Integration (JEDI), the Navy Environmental Prediction sysTem Using a Nonhydrostatic Engine (NEPTUNE), and the NASA Goddard Earth Observing System (GEOS) model.

This major release of spack-stack updates the spack engine to version 1.0, which treats compilers like any other package, and which separates the spack packages from the spack engine.

This release is limited to a subset of the tier 1 platforms:

JCSDA: Discover SCU 17 (Intel oneAPI and GNU)
NASA: NAS (Intel oneAPI / HPE MPT and GNU / Open MPI)
NAVY: Atlantis ((Intel oneAPI, GNU, and LLVM), Blueback (Intel oneAPI and GNU), Narwhal (Intel oneAPI and GNU), Nautilus (Intel oneAPI and GNU)
NOAA: Derecho (Intel oneAPI / cray-mpich), Gaea-c6 (Intel oneAPI / cray-mpich), Hercules (GNU / openmpi), Ursa (Intel oneAPI / Intel MPI and Intel oneAPI / HPC-X MPI); Acorn (partial installations with Intel Classic and Intel oneAPI / cray-mpich)

Supported compilers for this release are Intel Mixed (icx, icpx, ifort) 2024.2.0-2024.2.1, Intel LLVM (icx, icpx, ifx) 2025.0.3 and 2025.3.0, GCC 12.2.0-13.4.0, LLVM 21.1.*. In addition, limited support is available from NOAA EMC for Intel Classic (icc, icpc, ifort) 19.1.3.304 on WCOSS2 and Acorn.

Spack containers are not supported in this release. Container support will return in a future release.

All documentation can now be found on the spack-stack wiki. The previous documentation on ReadTheDocs is frozen at release 1.9.3.

What's Changed

Major Updates

Update to spack version 1.0:
- Compilers are now packages like any other package
- Spack packages are now in their own repository
Updated directory structure:
- Fork of spack-packages upstream repository in repos/builtin
- Additional packages in repos/spack-stack
Update of common configuration, site specific configuration, environment templates, and meta-modules generation to support Spack version 1.0
All modules are now created in envs/<env-name>/modules instead of envs/<env-name>/install/modulefiles
Support dropped for spack-built containers
All documentation can now be found at https://github.com/jcsda/spack-stack/wiki

All Updates

What's Changed

Update NRL batch install script with capability to create & use bootstrap mirrors by @climbfuji in #1473
Avoid linking to libirc.so in spack (parallel-netcdf), turn off crypt variant for Python, and update Orion site config to fix tar issue by @climbfuji in #1435
Update ectrans from 1.2.0 to 1.5.0 in configs/common/packages.yaml by @climbfuji in #1474
Update spack stack setup-meta-modules to directly set compilers in MPI meta modules by @climbfuji in #1479
Update NRL batch install script, add configuration for Cole and Tusk by @climbfuji in #1489
Container image: specify gcc version for gnu toolchain. by @eap in #1496
Update NRL batch_install.sh: exclude crtm-fix from duplicate check list by @climbfuji in #1497
Update util/weekly_build/03_SetupEnv.sh: exclude crtm-fix from check for duplicates by @climbfuji in #1498
Add py-arch and py-regionmask to neptune-python-env by @climbfuji in #1500
Avoid full rust dependency in cylc environments by @climbfuji in #1519
In configs/common/packages.yaml, update to met@12 and metplus@6; add to neptune-python-env by @climbfuji in #1481
Add new tier1 platform Blueback, fix for multiple cray-libsci versions on Narwhal, other NRL site config updates by @climbfuji in #1527
Add netcdf-{c,fortran} to weekly testing by @AlexanderRichert-NOAA in #1533
Support multiple versions of same compiler vendor in site config (especially oneapi) by @climbfuji in #1541
Update setup.sh: add export SPACK_DISABLE_LOCAL_CONFIG=true by @climbfuji in #1545
Update Blueback packages.yaml: remove external flex by @climbfuji in #1553
Bump ip from 5.1.0 to 5.3.0 by @climbfuji in #1551
Require +python for esmf by @AlexanderRichert-NOAA in #1560
Update to weekly build scripts: avoid scrubbing of environments, update NRL site configs and GitHub actions by @climbfuji in #1568
Acorn updates, March 2025 by @AlexanderRichert-NOAA in #1571
Update spack submodule to latest by @AlexanderRichert-NOAA in #1573
Weekly builds: add option to skip source fetch by @AlexanderRichert-NOAA in #1575
Remove discover-scu16 configs by @ashley314 in #1576
Update utils/nrl/batch_install.sh by @climbfuji in #1583
Feature/update nvhpc config by @stiggy87 in #1580
Update meta_modules.py to detect MPI modules containing hashes by @rjdave in #1582
Update Atlantis site config and util/nrl/batch_install.sh: revert temporary changes for NFS move by @climbfuji in #1584
Update to cmake@3.29+, use gcc for cmake with intel/oneapi; update eccodes variants; add cloc and py-pytest by @climbfuji in #1589
Add NCEPLIBS testing to weekly builds by @AlexanderRichert-NOAA in #1591
Update p4est to 2.8.7 by @climbfuji in #1592
Fix wrong intel-oneapi-runtime version in Atlantis packages_oneapi.yaml, bump bacio from 2.4.1 to 2.6.0 in JEDI CI container specs by @climbfuji in #1593
Add esmf@8.9.0b05 and use in neptune-dev template by @climbfuji in #1599
Merge "Gaea updates for 1.9.1 release (#1586)" from release/1.9.0 to develop by @climbfuji in #1600
Update FIND command for Nautilus in util/weekly_build/sites/nautilus.sh by @climbfuji in #1602
Stack automation / testing enhancements / bug fixes by @rickgrubin-noaa in #1603
Update compiler / packages_oneapi configs and instructions for preconfigured sites | orion and hercules by @rickgrubin-noaa in #1606
Update NRL batch install script: add option to continue build/install in existing directories by @climbfuji in #1609
Update spack branch spack-stack-dev from spack develop hash a9c879d by @climbfuji in #1607
Ursa: update openmpi install hash, remove system tar external by @rickgrubin-noaa in #1614
show_duplicate_packages.py: use spack.lock instead of 'spack concretize' output by @AlexanderRichert-NOAA in #1601
Add scripts to download cargo dependencies and store in local cargo registry for offline installation by @climbfuji in #1618
Remove parallel-netcdf dependency except for jedi-mpas-env/unified-dev/skylab-dev by @climbfuji in #1621
Follow up PR to update of show_duplicate_packages.py by @climbfuji in #1626
Update Blueback compilers.yaml: add missing path to llvm-ar etc. by @climbfuji in #1622
Update JEDI CI container GitHub actions (intel -> oneapi, add gcc-11) by @climbfuji in #1625
Acorn updates; go fetcher by @AlexanderRichert-NOAA in #1623
Replace esmf@8.9.0b05 with esmf@8.9.0b08 by @climbfuji in #1632
Adding HDF5 weekly testing with AWS-Ubuntu2404 setup by @stiggy87 in #1633
Update container specs (jedi-ci.yaml): hdf5 1.14.3->1.14.5 by @climbfuji in #1636
Add multiple UFS WM tests to automated build / test by @rickgrubin-noaa in #1629
Update Nautilus site config: oneapi@2025.0.0 -> oneapi@2025.1.1 by @climbfuji in #1637
Update tier2 site blackpearl: oneapi@2024.1.2 --> oneapi@2025.1.0 by @climbfuji in #1640
Feature/esmf weekly test by @stiggy87 in #1638
Support for LLVM 20 with neptune-dev, update to ip@5.4.0, odc@1.6.1, esmf@8....

Contributors

stiggy87, fmahebert, and 9 other contributors

Assets 2

03 Oct 21:23

climbfuji

1.9.3

d0c3835

Version 1.9.3

We are pleased to announce the release of V1.9.3 of spack-stack.

Documentation for installing and using spack-stack can be found at https://spack-stack.readthedocs.io/en/1.9.3 and https://github.com/JCSDA/spack-stack/wiki/spack%E2%80%90stack%E2%80%901.9.3-release-documentation

What's Changed

This is a bug fix release for versions 1.9.1 and 1.9.2. Changes w.r.t. version 1.9.1:

Site config updates and bug fixes for WCOSS2, Derecho, Hercules, Orion, Ursa, Hera
Bug fixes for scotch and crtm-fix packages
wgrib2: support variants ipolates and netcdf
Update met and metplus versions. Note that met@12.0.1 does not compile without older versions of gcc (e.g. gcc@10.3.0). See the Known Issues section of the release documentation for a fix
New tier 1 site NAS (NASA)

Full Changelog: spack-stack-1.9.1...1.9.3

Assets 2

14 Mar 20:11

climbfuji

spack-stack-1.9.1

32c4dd9

Version 1.9.1

We are pleased to announce the release of V1.9.1 of spack-stack.

The spack-stack package is a collaborative effort between the NOAA Environmental Modeling Center (EMC), the UCAR Joint Center for Satellite Data Assimilation (JCSDA), the Earth Prediction Innovation Center (EPIC), and the United States Naval Research Lab (NRL). spack-stack is designed to support the various applications of the supporting agencies such as the Unified Forecast System (UFS), the Joint Effort for Data assimilation Integration (JEDI), and the Navy Environmental Prediction sysTem Using a Nonhydrostatic Engine (NEPTUNE).

Documentation for installing and using spack-stack can be found at https://spack-stack.readthedocs.io/en/1.9.1 and https://github.com/JCSDA/spack-stack/wiki/spack%E2%80%90stack%E2%80%901.9.1-release-documentation

What's Changed

Platforms

Add site configs for NCO WCOSS2, NOAA RDHPCS Ursa
Add experimental support for DoD HPCMP Blueback, DOD HPCMP ParallelWorks AWS
Update JEDI CI container from Ubuntu 20.04 to Ubuntu 24.04
On NRL sites, Hercules, and Orion, use native zlib instead of spack-built zlib-ng

Compilers

Support for Intel oneAPI compilers in "mixed" mode (icx, icpx, ifort from oneapi@2024.2.0 and oneapi@2024.2.1)
Support for apple-clang@15.x compilers on macOS and clang@14 on Linux
Experimental support for Intel oneAPI compilers (icx, icpx, ifx from from oneapi@2025 and later)

Libraries

Move NEPTUNE Python dependencies into its their own package neptune-python-env
Updated versions for: ip, gfsio, landsfcutil, sigio, sfcio, eckit, fckit, fiat, ectrans, ecmwf-atlas
Unpin or update many Python packages, update of py-numpy to 1.26 and py-scipy to 1.14
Enable ESMF Python interface, update to version 8.8.0
Update MAPL to 2.50.3
Add the GitHub CLI to global-workflow-env
Add py-ruamel to gmao-swell-env
Enable esdmumps feature for scotch
New package bufr-query
Add new templates for Cylc and CCPP-SCM
Add crtm@3.1.1
Update wgrib2 to 3.6.0 and enable for all compilers (notably Intel oneAPI)

Miscellaneous

Implement NCO requirements
Continuous Integration (CI): add weekly build/test scripts
Add utility for listing pkg versions for spack-stack wiki

Full Changelog: spack-stack-1.8.0...spack-stack-1.9.1

Assets 2

03 Oct 00:41

climbfuji

1.8.0

811549c

Version 1.8.0

We are pleased to announce the release of V1.8.0 of spack-stack.

The spack-stack package is a collaborative effort between the NOAA Environmental Modeling Center (EMC), the UCAR Joint Center for Satellite Data Assimilation (JCSDA), the Earth Prediction Innovation Center (EPIC), and the United States Naval Research Lab (NRL). spack-stack is designed to support the various applications of the supporting agencies such as the Unified Forecast System (UFS), the Joint Effort for Data assimilation Integration (JEDI), and the Navy Environmental Prediction sysTem Using a Nonhydrostatic Engine (NEPTUNE).

Documentation for installing and using spack-stack can be found at https://spack-stack.readthedocs.io/en/1.8.0 and https://github.com/JCSDA/spack-stack/wiki/spack%E2%80%90stack%E2%80%901.8.0-release-documentation

New This Release

Support for Intel oneAPI 2024 compilers (icx, icpx, ifort; experimental: icx, icpx, ifx); update of Intel classic compilers to last release 2023.2 on NOAA platforms
Bug fixes for Intel classic compilers in spack core code (always pass flags to suppress deprecation warnings to fix meson build errors)
Support for AMD AOCC version 4 compilers (experimental)
Minimal mpas-jedi environment with Nvidia compilers (nvhpc)
New NEPTUNE standalone environment
Environments now support one principal compiler, but can use other compilers for specific packages (examples: Intel classic environment uses gcc to compile boost; Intel oneAPI environment uses gcc to compile bison)
Use Intel MKL instead of Openblas in Intel classic/oneAPI environments on all non-NOAA platforms
Update of Python from 3.10.8 to 3.11.7 and update of numerous Python packages
Additional packages for unified environment: py-dask, py-xnrl, py-wxflow, command line utilities for eccodes, py-fortranformat, bufr_query
New versions of bufr@12.1.0, esmf@8.6.1 and esmf@8.7.0b11, mapl@2.46.3, fms@2024.02, g2@3.4.5.1, g2tmpl@1.13.0, eckit@1.27.0, ecmwf-atlas@0.38.1, met@11.1.1, wgrib@3.1.1, cdo@2.3.0
Update to Rocky 8 for NOAA RDHPCS Hera, Jet, ParallelWorks
Update to Rocky 9 for NOAA RDHPCS Orion
Update of JEDI CI container builds
New tier 1 platforms Atlantis, Gaea C6
Update from spack develop as of May 2024
Documentation updates: split documentation into readthedocs (https://spack-stack.readthedocs.io/en/latest) and a Wiki (https://github.com/JCSDA/spack-stack/wiki)

Assets 2

10 Apr 23:15

climbfuji

1.7.0

74a37de

Version 1.7.0

We are pleased to announce the release of V1.7.0 of spack-stack.

The spack-stack package is a collaborative effort between the NOAA Environmental Modeling Center (EMC), the UCAR Joint Center for Satellite Data Assimilation (JCSDA), and the Earth Prediction Innovation Center (EPIC). spack-stack is designed to support the various applications of the supporting agencies such as the Unified Forecast System (UFS) or the Joint Effort for Data assimilation Integration (JEDI).

Documentation for installing and using spack-stack can be found here: https://spack-stack.readthedocs.io/en/1.7.0/

New This Release

Add all packages required to build GEOS-GCM with spack-stack, add geos-gcm-env (thanks to Matthew Thompson from NASA GMAO)
Extend support for spack-stack to NASA's Discover SCU17 (AMD Milan) partition, update Discover SCU16 (Intel CascadeLake) config
Update Hera and Jet site configs after transition to Rocky 8
Add metis and jasper to mpas-jedi-env
Add fftw and netlib-lapack to jedi-neptune-env
Add torch/pytorch for gcc and apple-clang environments
Replace zlib with zlib-ng
Remove upp from spack-stack installations
Update ECMWF library versions (eccodes, eckit, fckit, ecmwf-atlas)
Update esmf to 8.6.0, update mapl@2.40.3 dependencies (pflogger)
Update hdf5 to 1.14.3 with backport of floating point exception fixes from hdf5 develop (thanks to Ryan Honeyager from tomorrow.io)
Update sp, ip, gsibec
Update OpenMPI version for user systems to 5.0.1
Bugfix for crtm@2.4.0.1 static/fix files
Bugfix for building py-jupyter server with node/npm
Limited support for apple-clang@15.0.0
Update to spack backports/v0.21.1
Stop packages from access the internet during installation (needed for air-gapped systems)

Assets 2

12 Jan 16:30

climbfuji

1.6.0

0c2ff3b

Version 1.6.0

We are pleased to announce the release of V1.6.0 of spack-stack.

Documentation for installing and using spack-stack can be found here: https://spack-stack.readthedocs.io/en/1.6.0/

New This Release

Library updates: bufr@12.0.1, mapl@2.40.3 with esmf@8.6.0 in addition to mapl@2.40.3 with esmf@8.5.0, fms@2023.04, openblas@0.3.24, crtm@2.4.0.1, awscli-v2@2.13.22, eckit@1.24.5, ecmwf-atlas@0.35.1, netcdf-fortran@4.6.1, python@3.10.13, prod-util@2.1.1, eccodes@2.32.0,
New packages: py-cylc-flow@8.2.3, py-cylc-rose@1.3.0, py-cylc-uiserver@1.3.0, mct@2.11.0, cprnc@1.0.3
Support for GEOS SWELL workflow via the newly added geos-swell-env virtual package (available in unified-env and skylab-env)
Additional environment gsi-addon-env that uses python@3.11.6, met@9.1.3, metplus@3.1.1
Support of apple-clang@15.0.0 compiler
Update of spack stack create ctr extension to build containers with different packages
Update of spack stack setup-meta-modules extension to work correctly with chained environments
Bug fixes for Nautilus, Derecho, Hercules
Alternative gcc@12.2.0 + openmpi@4.1.6 software stack on Hercules (in addition to the default gcc@12.2.0 + mvapich2@2.3.7 stack) that seems to address the random errors of MPI programs of the default GNU stack

Assets 2

08 Nov 03:16

climbfuji

1.5.1

883ebcb

Version 1.5.1

V1.5.1 is a minor update of V1.5.0 with new library versions for NOAA's Unified Forecast System (UFS) and JCSDA's Joint Effort for Data assimilation Integration (JEDI).

Documentation for installing and using spack-stack can be found here: https://spack-stack.readthedocs.io/en/1.5.1/

New This Release

This is a minor update on top of V1.5.0:

Update of Hercules site config for GNU compiler to fix issues with the Unified Forecast System due to a bug in gcc@11 (move to gcc@12)
Update of bufr to 12.0.1
Update of ecmwf-atlas to 0.35.0, enabling tesselation features
Update fms to 2023.02.01, addition of version 2023.03
Update of esmf to 8.5.0, mapl to 2.40.3, and update of mapl dependencies
Update of gsi-ncdiag to 1.1.2
Bug fix for py-pandas / py-openpyxl
Various smaller site configuration updates (Python with/without ssl enabled) to fix openssh/openssl library version mismatches

Assets 2

28 Sep 16:56

climbfuji

1.5.0

0941330

Version 1.5.0

We are pleased to announce the release of V1.5.0 of spack-stack.

Documentation for installing and using spack-stack can be found here: https://spack-stack.readthedocs.io/en/1.5.0/

New This Release

Support for MSU Hercules, NOAA RDHPCS Gaea C5, NCAR-Wyoming Derecho
Major update from spack authoritative repository to 0.21.0.dev0
Use of C++-17 in boost and in several new versions of ECMWF libraries (eckit, fckit, ecmwf-atlas, ...)
The Python version used by downstream applications of spack-stack is now built by spack (no longer an external package) for most platforms
Additional CI tests, in particular on macOS M1
Utility to check for duplicates after concretization
Utility to check user umask when creating environments
Fixed several bugs in spack stack setup-meta-modules
Numerous version updates and bug fixes for packages in the unified environment, including a critical bug fix to scotch (version 7.0.4) and an update of NCEPLIBS-bufr to 12.0.0
Additional packages for working with cloud resources (awscli, globus-cli)
Static build options for packages required by the UFS Weather Model for installation on NCO's operational systems

Assets 2

14 Jul 12:59

climbfuji

1.4.1

be8f8dd

Version 1.4.1

V1.4.1 is a bug fix release specifically for enabling the transition of NOAA's Unified Forecast System (UFS) to spack-stack.

Documentation for installing and using spack-stack can be found here: https://spack-stack.readthedocs.io/en/1.4.1/

New This Release

This is a bug fix release on top of V1.4.0:

Bug fix for the scotch library required for coupled UFS configurations
Update of bufr from 11.7.1 to 1.12.0
Update of eckit from 1.23.0 to 1.23.1
Update of Hercules and Gaea C5 site configurations

Assets 2

28 May 02:57

climbfuji

1.4.0

beeb5b3

Version 1.4.0

We are pleased to announce the release of V1.4.0 of spack-stack.

Documentation for installing and using spack-stack can be found here: https://spack-stack.readthedocs.io/en/1.4.0/

New This Release

Support for the Navy Nautilus HPC
Experimental support for MSU's Hercules and NOAA's Gaea C5
Addition of jedi-neptune-env
Addition of scotch to ufs-weather-model-env
Update hdf5 and py-h5py to 1.14.0 and 3.7.0
Major update from spack authoritative repository to a version close to the recently released spack v0.20.0
Several small bug fixes and updates

Known Issues

Build error: mapl 2.35.2 does not build on the Navy Narwhal HPC, therefore removed ufs-weather-model-env and jedi-ufs-env from that system
GNU environment on S4 currently not supported, because new HDF5 version requires newer MPI library than currently available (mpich-4.0.1); newer mpich versions cannot build mapl 2.35.2.
Substituted wgrib2 2.0.8 with 3.1.1 on Hercules and Nautilus

Assets 2

Releases: JCSDA/spack-stack

Version 2.0.0

What's Changed

Major Updates

All Updates

What's Changed

Contributors

Uh oh!

Version 1.9.3

What's Changed

Uh oh!

Version 1.9.1

What's Changed

Platforms

Compilers

Libraries

Miscellaneous

Uh oh!

Version 1.8.0

New This Release

Uh oh!

Version 1.7.0

New This Release

Uh oh!

Version 1.6.0

New This Release

Uh oh!

Version 1.5.1

New This Release

Uh oh!

Version 1.5.0

New This Release

Uh oh!

Version 1.4.1

New This Release

Uh oh!

Version 1.4.0

New This Release

Known Issues

Uh oh!