RELEASED: HPE Cray Programming Environment 24.07 Release for Apollo 2000 Gen 10 Plus Systems (x86) – August 2024

PRODUCT DESCRIPTION

The HPE Cray Programming Environment 24.07 release is now available for Apollo 2000 Gen 10 Plus systems (x86) running RHEL 8.10 with HPCM 1.11.

SOFTWARE OVERVIEW

The HPE Cray Programming Environment 24.07 release for Apollo 2000 Gen10 Plus (x86) consists of the products/components listed further below.

See “module help <product>” for the corresponding PE product release notes.

Content for Apollo 2000 Systems:

CPE-apollo2000-24.07-03.el8.x86_64.iso

Documentation

(NOTE: Documentation**, including revision documentation,** may be found on support.hpe.com; plus many CPE docs are also released in a tar file as part of the official release package as well. To find a specific document on support.hpe.com, simply do a search on “pubno 24.07” without the quotation marks. For example, search on S-8012 24.07 to find the CPE 24.07 version of the S-8012 document.)

Installation Guide

*HPE Cray Programming Environment Installation Guide: Apollo 2000 Gen10 Plus (x86) Systems (24.07), S-8012 *

HPE_CPE_Installation_Guide_Apollo_2000_Gen10_Plus_x86_Systems_24.07_S-8012.pdf

User Guide

*HPE Cray Programming Environment User Guide: Apollo 2000 Gen10 Plus (x86) Systems (24.07), S-8008 *

HPE_CPE_User_Guide_Apollo_2000_Gen10_Plus_x86_Systems_24.07_S-8008.pdf

Software Supported

The following software is supported with this release:

HPE Performance Cluster Manager (HPCM) 1.11 - managed systems running RHEL 8.10 on the compute/login nodes.

Workload management system options:

Slurm 22.05.8 (or later)

PBS Professional 2021.1.1 (or later)

AMD AOCC 4.2.0

AMD ROCm 6.1

Intel OneAPI 2024.0.2

NVIDIA HPC SDK 24.03

GCC 13

MOFED 5.8

IMPORTANT NOTES

NOTE: Hidden symbol errors when linking Fortran with CCE 18.0.0 Linking Fortran applications may fail with an error message of the form “hidden symbol `<SYMBOL>’ in <LIB> is referenced by DSO”. If this error message is seen, it can usually be worked around by adding ‘-lgcc_s’ to your link line. This is known to affect use of craypat and cray-parallel-netcdf but may be seen without them as well.

NOTE: Update to Apollo 2000 Gen 10 Plus Setup Scripts. The setup scripts for Apollo 2000 Gen 10 Plus systems, located in the cray-pe-profile package, have been updated to look for CPE’s provided Lmod package inside the CPE namespace (/opt/cray/pe). The setup scripts are responsible for how CPE behaves on a system. Please use caution when installing, so that the systems current settings in /etc/cray-pe.d/cray-pe-configuration.sh and /etc/cray-pe.d/cray-pe-configuration.csh are not lost.

NOTE: MPIs other than cray-mpich may not work on systems with Cray Programming Environment installed.

NOTE: Potential issue with libfabric and MOFED 5.8. When using the OFI netmod of Cray-MPICH there is a potential issue when calling MPI_Finalize which causes the application to seg fault. This is seen at 64 ranks and larger. If encountered, setting the environment variable FI_VERBS_PREFER_XRC=0 will allow for applications to finish. Note that there is a significant performance penalty at scale when setting this environment variable.

NOTE: PBS Pro use was not validated on RHEL 8.8 with CPE 24.07. It is recommended that PBS Pro users continue to use RHEL 8.7 with CPE 24.07.

NOTE: Cray GCC no longer provided on RHEL Starting with the CPE 23.12 release, cray-gcc packages will no longer be provided for RHEL-based systems. Instead, RHEL-based systems must use RHEL-provided gcc-toolset packages. RHEL does not provide a version of GCC 12 for RHEL 8.6. Customers who wish to use GCC 12 should continue to use CPE 23.03 or earlier CPE releases on their RHEL 8.6 systems.

NOTE: The Red Hat GCC Toolset provides the cc compiler driver that will conflict with the craype driver. To ensure the environment’s PATH is correct, the craype module should always be reloaded after swapping or reloading the gcc-native module. You may run cc –craype-help to verify the correct executable is resolved.

NOTE: Perftools 24.07.0 and PAPI 7.1.0.2 included with CPE 24.07 are not compatible with ROCm earlier than 6.0.0, they require the use of ROCm 6.0.0 or later.

NOTE: CPE 24.03 is not supported on XD670.

NOTE: Beginning in CPE 24.07 the nvhpc modules (PrgEnv-nvhpc, nvhpc, nvhpc-mixed) contain deprecation messages. The nvhpc modules will be removed at a future release in favor of the nvidia modules (PrgEnv-nvidia, nvidia, nvidia-mixed). The move towards the nvidia modules is to complete the alignment of CPE module flows. The module flow for all environments is as follows:

Load an environment meta module (ie. PrgEnv-nvidia)

Environment meta module loads a compiler (ie. nvidia)

User can choose to load a toolkit (cuda, cudatoolkit)

Please note that the new “cuda” module is being released as beta. This new module is generated along with CPE’s rocm toolkit and third-party compiler modules via craypkg-gen.

CPE 24.07 Product Versions:

NOTE: The use of *** indicates a new or updated component version compared to CPE .

HPE Cray Programming Environment for Apollo 2000 Gen 10 Plus Systems


Cray Compiling Environment – CCE
cce 18.0.0 ****

Cray Message Passing Toolkit - CMPT
cray-mpich 8.1.30 ****
cray-dsmml 0.2.2
cray-pmi 6.1.15 ****

Application Launch Tools - ALT
cray-pals 1.3.2

Cray Debugging Support Tools – CDST
cray-cti 2.18.4 ****
gdb4hpc 4.16.2 ****
cray-ccdb 5.0.4 ****
cray-stat 4.12.3 ****
atp 3.15.4 ****
valgrind4hpc 2.13.3 ****
sanitizers4hpc 1.1.3 ****
cray-dyninst 12.3.2 ****
cray-mrnet 5.1.3 ****

Cray Performance Measurement & Analysis Tools – CPMAT
perftools 24.07.0 ****
cray-papi 7.1.0.2 ****

Cray Scientific and Math Libraries - CSML
cray-libsci 24.07.0 ****
cray-fftw 3.3.10.8 ****

Cray Deep Learning Tools
craype-dl-plugin-py3 21.02.1.3

Cray Environment Setup and Compiling support – CENV
craypkg-gen 1.3.33 ****
craype 2.7.32 ****
cpe-prgenv 8.4.0
cray-lmod 8.7.31
cray-modules 3.2.11.5

Third party products
cray-hdf5 1.14.3.1 ****
cray-netcdf 4.9.0.13 ****
cray-parallel-netcdf 1.12.3.13 ****
cray-python 3.11.7 ****
cray-R 4.4.0 ****

Third-party products supported
Totalview 2024.1.21

*******************************************************************************************

Certain components, files or programs contained within this package or product are Copyright - 2024 Hewlett Packard Enterprise Development LP. All trademarks used in this document are the property of their respective owners.