Migrate to Rocky 8 on S4

[InnocentSouopgui-NOAA]

What new functionality do you need?

Support of Rocky 8 on S4.
S4 will be updated to Rocky 8 in September, 2024

What are the requirements for the new functionality?

Update module files to points to new paths on S4

Acceptance Criteria

Global Workflow runs smoothly on S4 with the new operating system

Suggest a solution (optional)

No response

[InnocentSouopgui-NOAA]

Suggestions are welcome.

S4 being an old system, it does not get updates very often. With the upcoming update, we have the possibility to request the best combination of software stack to match other systems, and also to plan for upcoming features of various system softwares that Global Workflow relies on.

The sys admin is gathering suggestions to plan the upgrade accordingly.

1. Operating system: Should it be Rocky 8 or Rocky 9? How are Clusters with Rocky 9 doing? I don't have access to any cluster with Rocky 9.
2. Slurm configuration such as partitions and qos. (Any suggestion?)
3. Software stacks (via module or in any other way)

[DavidHuber-NOAA]

@InnocentSouopgui-NOAA

1. Orion and Hercules have been upgraded to Rocky 9. Hera and Jet to Rocky 8. Orion has had noticeable slowdowns after upgrading to Rocky 9 (in particular with the BUFR library and thus the GSI), but Hercules, Hera, and Jet have worked quite well. We're not sure yet what is causing the slow down, though I suspect it has to do with the way the operating system was imaged from Hercules, which has different architecture. That said, a transition to Rocky 8 may be safer.

2. I saw in the announcement yesterday that the Ivy node will be retired with the OS upgrade, so that should simplify the partition setup (s4 only).

3. I think working with modules going forward is the way to go. And you will want spack-stack installed.

[InnocentSouopgui-NOAA]

This upgrade is being delayed for some final reviews.
It will also take longer than the initial one week planned schedule.

[InnocentSouopgui-NOAA]

S4 has one node ready with Rcky8: s4-205-c13
It can be used as playground while waiting for the schedule of the full transition.