Release Notes for CPE 25.03 on RHEL 9.5
Abnormal Termination Processing (ATP) 3.15.6
atp 3.15.6
================================================================================
Product Description
---------------------------
- Abnormal Termination Processing (ATP) is a system that
monitors user applications, and should an application
take a system trap, ATP preforms analysis on the dying
application. All of the stack backtraces of the
application processes are gathered into a merged
stack backtrace tree and written to disk as the file
"atpMergedBT.dot". The stack backtrace for the first process
to die is sent to stderr as is the number of the signal that
caused the death. If the core file size limit (RLIMIT_CORE)
is non-zero, a heuristically selected set of processes dump
their core.
atpMergedBT.dot can be viewed with 'statview', a component
of the STAT package (module load cray-stat). The merged stack
backtrace tree provides a concise, yet comprehensive, view
of what the application was doing at the time of its death.
Changelog
---------------------------
=======================================================================
## [3.15.6]
=======================================================================
### Bug Fixes
* CPE-6064: Don't reset ZMQNet install directory
* PE-54139: Fix Fortran user API with AOCC Fortran compiler
### Features
* Build with g++14 on rhel 9.5 and sles15sp6
* Add rhel 9.5, remove rhel 8.9 and sles15sp4
* CPE-4541: Allow coredump using ROCgdb
* Support rhel 8.10
* Add builds for rhel 9.4 and sles15sp6
=======================================================================
## [3.15.4]
=======================================================================
### Bug Fixes
* PE-53603: ZMQNet libsodium support
* PE-52560: Pass all ATP environment variables to Flux plugin
* PE-51520: Remove disable message from Flux plugin
### Features
* PE-53605: Build and package libsodium
* PE-51960: Added support for rhel89/93 & gcc13
=======================================================================
## [3.15.3]
=======================================================================
### Bug Fixes
* PE-52423: Disable PALS local launch in modulefile
### Features
* PE-51520: Automatic plugin loading for Flux
OS Dependencies
---------------------------
- HPE CSM systems with SLES 15 SP5 - SP6
- HPE HPCM systems with SLES 15 SP5 - SP6 or RHEL 8.10 - 9.4
- HPE Apollo systems with RHEL 8.10
Product Dependencies
---------------------------
- cray-mrnet >= 5.1, < 6 installed
- cray-cti >= 2.19, < 3 installed
- cdst-support >= 2.14, < 3 installed
Documentation
---------------------------
- Type `man atp` with the atp module loaded to read the atp(1) man page.
Installation Instructions
---------------------------
- rpm -ivh atp-3.15.6-20250125020208_1a5b910a2baa-154.el9.x86_64.rpm
To make atp 3.15.6 the default version of atp, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_atp_3.15.6
Legal Notices
---------------------------
Certain components, files or programs contained within this package or product are Copyright 2010-2025 Hewlett Packard Enterprise Development LP.
Attribution notices for open source licensed software for this package are detailed in the file:
/opt/cray/pe/atp/3.15.6/ATTRIBUTIONS_atp.txt
CDEUX driver (craype) 2.7.34
CDEUX driver (craype) 2.7.34 - 15
==============
Purpose:
--------
The Cray Development Environment User eXperience driver (CDEUX) (craype)
provides a common set of drivers for all CPE programming environments,
notably the C/C++ (cc/CC) and Fortran (ftn) languages.
Key Changes and Bugs Closed:
----------------------------
- Updated NVIDIA target support for current release
- Updated AOCC target support for current release
- Updated Intel Fortran frontend (ifx) for current release
- Updated target support adding Intel Emerald Rapids
- Fixed --help behavior to use compiler help
- Support CCE Cray LibSci pattern matching option -flibsci-libs
- Make build symbol support consistent between RHEL/SUSE builds of driver
- Fixed CAST-36714 segfault with conflicting compiler arguments
- Fixed numerous accelerator offload target behaviors with AMD
- Fixed CAST-30275 Support CRAY_ROCM_PATH
Product and OS Dependencies:
----------------------------
The CDEUX driver (craype) 2.7.34 release is supported on the following
HPE systems:
* HPE Cray EX systems
* HPE Apollo XD systems as part of the Cray Programming Environment
Documentation:
---------------
See manpages for cc, CC, ftn, and intro_craype-api.
See the pkg-config manpage or
http://www.freedesktop.org/wiki/Software/pkg-config for a pkg-config
introduction.
Product description:
--------------------
CrayPE contains drivers, cc, CC, and ftn to compile for all CPE
Programming Environments.
Certain components, files or programs contained within this package or product
are Copyright 2013-2025 Hewlett Packard Enterprise Development LP.
License:
--------
Except for the third party components and software licensed by HPE
through proprietary agreements, components, files or programs contained
within this package or product are Copyright 2025 Hewlett Packard
Enterprise Development LP.
CM PE Integration
CM-PE-INTEGRATION CHANGELOG
===========================
24.07 (2023-06-05)
* Remove rpm queries from 77-deploy-pe.sh for improved performance
* Remove find commands from 77-deploy-pe.sh for improved performance
* Replace the systemd file with a new pe.service that depends on pe.mount
* CAST-35461 fix setting MODULEPATH in csh.cshrc.local
* Replace find commands with for loops to allow using symlink paths in gen_modulefiles.sh
24.03 (2023-02-16)
* Fix regex in gen_modulefiles for Intel OneAPI
* Add a umask 022 to ensure CPE access is not limited
* Add nfs-utils as an rpm dependencies
23.12 (2023-11-27)
* Determine the craype-target architecture during shell initialization
* Add support for compute nodes running on aarch64 hardware
* Update gen_modulefiles.sh to better support new compiler versions
* Add better logging information to `77-deploy-pe`
23.05 (2023-05-10)
* Allow sites to override the lmod install path by setting `lmod_prefix_path`
in `cray-pe-configuration.sh` and `cray-pe-configuration.csh`. Sites can
now use newer versions of lmod provided by the OS distribution.
* Update `76-add-pe-to-fstab` so that `/pe` is not added to `/etc/fstab` more
then once.
23.03 (2023-03-03)
* Spread the squashfs image mounts across NUMA domains to balance memory
usage across NUMA nodes.
* Add RPM dependency on `numactl`
23.02 (2023-01-30)
* Update shell profile scripts to initialize lmod using HPE provided package.
* Remove leading and trailing `:` in `LMOD_SYSTEM_DEFAULT_MODULES` that is no
longer an acceptable format in new versions of lmod.
22.12 (2022-12-12)
* Add a `site_module_list` to `cray-pe-configuration.sh` and
`cray-pe-configuration.csh` to allow sites to add modules loaded at login
without the need to modify HPE defaults `init_module_list`.
22.11 (2022-11-10)
* Update `gen_modulefiles.sh` to recreating symlinks to ensure idempotence.
22.10 (2022-10-03)
* Changes for HPCM 1.8 to ensure that `/pe` is mounted in `76-add-pe-to-fstab`
before running `77-deploy-pe`
22.09 (2022-08-23)
* Update `pe_overlay.sh` to only remove workdirs when unmounts are successful.
* Update `gen_modulefiles.sh` to run `one_off_set_defaults` after generating
all modulefiles.
22.08 (2022-07-22)
* Enable older PE images to deploy on system with newer minor base OS version.
* Update `gen_modulefiles.sh` to use the latest available version of
`craypkg-gen`.
22.05 (2022-04-26)
* Remove `/opt/modulefiles` from `MODULEPATH`.
22.04 (2022-03-28)
* Add a temporary workaround in `pe_overlay.sh` that copies lmod GPU
modulefiles into the PE overlay's upper layer so they are visible after
`/opt/cray/pe` is mounted.
CPE Descriptive Manifest 1.3
cpe-descriptive-manifest 25.03
=================================
Release Date: Mar 2025
Product description:
--------------------
The cpe-descriptive-manifest packages contain the JSON manifest files that
are to map CPE to a format that Spack can consume.
Schema Changelog:
-----------------
v1.4
----
* Add 'wrappers' as a boolean parameter
v1.3
----
* Change '_meta' opject's 'version' property to 'schema-version'.
* Add 'cpe-version' property '_meta' object.
v1.2
----
* Add 'system-type' property to the '_meta' object.
v1.1
----
* Add '_meta' object to define file type and schema version.
v1.0
----
* Initial schema.
Cray Common Tool Interface (CTI) 2.19.1
cray-cti 2.19.1
================================================================================
Product Description
---------------------------
- Cray Common Tools Interface (CTI) is a library that abstracts debugger tool support
to a common interface regardless of the underlying work load manager. It facilitates
the staging of files and the launch of tool daemons on the compute nodes associated
with a parallel job. Options and interfaces can be found in the cti(1) and cti(3)
manpages.
Known Issues
---------------------------
- Race condition workaround for PALS 1.2.3 in CTI 2.17.0 (22.11). In PALS 1.2.3, there
is a race condition between the tool launcher releasing a job from the startup barrier
and the job actually getting to the startup barrier. This can result in the job receiving
the startup barrier release signal before it actually arrives there, resulting in the job
getting stuck in the barrier. As a workaround, the environment variable
CTI_PALS_BARRIER_RELEASE_DELAY can be set to add a delay between job startup and barrier
release. If set to a positve integer n, CTI will wait n seconds between starting a
job and releasing it from the barrier on PALS. A delay as small as one second works in
most cases.
Notes
---------------------------
- CTI 2.17.1 (PE 22.12) contains a new feature, file deduplication, for Slurm and PALS
workload managers. If enabled, CTI will run a check on compute nodes to determine if files
can be excluded from the shipped package. This can significantly improve application startup
time. To enable, set the environment variable CTI_DEDUPLICATE_FILES=1.
Changelog
---------------------------
=======================================================================
## [2.19.1]
=======================================================================
### Bug Fixes
* CPE-968: Check archive with retry after finalizing
* CPE-6871: Fix rank offsets in MPMD in allocation
* PE-6700: Add diagnostic for missing `sacct` output
* CPE-6073: Improve MPMD launch diagnostics, check node architectures
* CPE-5994: Add Flux function to get job ID from `flux job attach --debug`
### Features
* Build with g++14 on rhel 9.5 and sles15sp6
* CPE-7632: Skip preload workaround for PALS 1.6.0 or newer
* Add rhel 9.5, remove rhel 8.9 and sles15sp4
* CPE-2369: Support Flux 0.67.0
=======================================================================
## [2.19.0.0]
=======================================================================
### Bug Fixes
* CPE-5658: Fix dropping output with `flux attach`
* PE-54406: Close stdin on Flux output redirect if unused
* PE-55244: Get PBS job comment for failed job
* PE-54822: Disable Slurm sending libraries for backend daemon
* PE-54872: Switch from squeue to sacct to get all hetjob IDs
* PE-52465: Don't add quotes to LD_PRELOAD
* PE-54079: Fix unreliable Flux application output
* PE-53554: Allow launch if debug log directory doesn't exist
### Features
* Support rhel 8.10
* Build on sles15sp6 and rhel 9.4
* PE-49731: Implement PALS non-MPI barrier launch function
* Add lock to C interface, basic multithread test
* PE-53555: Parse multiple Flux job ID formats
* PE-52995: Support Flux 0.60.0
* PE-51960: Added support for rhel89/93 & gcc13
=======================================================================
## [2.18.3]
=======================================================================
### Bug Fixes
* PE-52423: Fix deduplication check for PALS
* PE-52423: Disable local launch for PALS
* PE-52540: Always include rank 0 in Flux launch
* PE-51694: Flux: fix job layout case and file deduplication
* PE-51955: Only rebuild checksum if input files changed
* PE-51495: Fix Slurm isRunning for stopped srun and backgrounded sattach
* PE-51694: Fix Flux implementation for 0.57.0
* PE-51193: Support rank remapping in PALS backend
### Features
* PE-48498: Accept PALS attach in form pbs_job_id:pals_apid
OS Dependencies
---------------------------
- HPE CSM systems with SLES 15 SP5 - SP6
- HPE HPCM systems with SLES 15 SP5 - SP6 or RHEL 8.10 - 9.4
- HPE Apollo systems with RHEL 8.10
Product Dependencies
---------------------------
- cray-cdst-support >= 2.14, < 3 installed
- cray-dyninst 12.3.0 or later installed
Documentation
---------------------------
- Currently the only documentation available is found in common_tools_fe.h, common_tools_be.h,
and the tests in the 'tests' directory.
Installation Instructions
---------------------------
- rpm -ivh cray-cti-2.19.1-20250124231756_a0576f65529d-164.el9.x86_64.rpm
To make cray-cti 2.19.1 the default version of cray-cti, execute:
/opt/cray/admin-pe/set_default_files/set_default_cray-cti-2.19.1
Legal Notices
---------------------------
Certain components, files or programs contained within this package or product are Copyright 2010-2025 Hewlett Packard Enterprise Development LP. SPDX-License-Identifier: Linux-OpenIB
Attribution notices for open source licensed software for this package are detailed in the file:
/opt/cray/pe/cti/2.19.1/ATTRIBUTIONS_cti.txt
Cray Comparative Debugger (CCDB) 5.0.6
cray-ccdb 5.0.6
================================================================================
Product Description
---------------------------
- CCDB, Cray's next generation debugging tool extends the comparative
debugging capabilities of gdb4hpc with a Graphical User Interface (GUI)
enabling programmers to compare corresponding data structures
between two executing applications. Comparative debugging assists users with
locating sections of code containing data deviations introduced by algorithm
changes, compiler differences, and porting to new architectures/libraries.
Changelog
---------------------------
=======================================================================
## [5.0.6]
=======================================================================
### Bug Fixes
* CPE-6964: Specify Flask version, disable Werkzeug server
* Missing yaml file for apollo install
### Features
* Add rhel 9.5, remove rhel 8.9 and sles15sp4
=======================================================================
## [5.0.5]
=======================================================================
### Bug Fixes
* PE-54348: Fix manpage path
### Features
* Support rhel 8.10
* Add builds for rhel 9.4 and sles15sp6
* Remove old gtk based ccdb-x
=======================================================================
## [5.0.4]
=======================================================================
### Bug Fixes
* PE-50334: Fix missing console messages
### Features
* PE-51960: Added support for rhel89/93 & gcc13
OS Dependencies
---------------------------
- HPE CSM systems with SLES 15 SP5 - SP6
- HPE HPCM systems with SLES 15 SP5 - SP6 or RHEL 8.10 - 9.4
- HPE Apollo systems with RHEL 8.10
Product Dependencies
---------------------------
- gdb4hpc/4.14.x or later installed
Documentation
---------------------------
- Type `man ccdb` with the cray-ccdb module loaded to read the ccdb(1) man page.
- Documentation is available through CCDB from the 'Help' menu.
Installation Instructions
---------------------------
- rpm -ivh --oldpackage cray-ccdb-5.0.6-20250109154901_cbe882f2c9da-59.el9.x86_64.rpm
To make cray-ccdb 5.0.6 the default version of cray-ccdb, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_cray-ccdb_5.0.6
Legal Notices
---------------------------
Certain components, files or programs contained within this package or product are Copyright 2007-2025 Hewlett Packard Enterprise Development LP.
Attribution notices for open source licensed software for this package are detailed in the file:
/opt/cray/pe/ccdb/5.0.6/ATTRIBUTIONS_ccdb.txt
Cray DSMML 0.3.1
Cray DSMML 0.3.1:
==========================
Release Date:
-------------
March, 2025
Product Information:
--------------------
DSMML is a stand-alone memory management library for maintaining distributed
shared symmetric memory heaps for top level PGAS languages and libraries like
Coarray Fortran, UPC, and OpenSHMEM. DSMML allows user libraries to create
multiple symmetric heaps and share information with other libraries. Through
DSMML, we could extract interoperability between PGAS programming models.
Announcements, release informations, supported environments, and backward
compatibility informations about this product can be viewed in the following
location: https://pe-cray.github.io/cray-dsmml/
Purpose:
--------
Cray DSMML 0.3.1 supports the following features:
- Create symmetric heap segments for being used by PGAS languages and
libraries
- Allows options to allocate, deallocate memory buffers from previously
created symmetric heap segments
- Enables sharing information about the symmetric heap segments between
different programming models
- Added support for shared symmetric heap (SSHEAP) that can be used to
provide enhanced SMP data transport in user-libraries like SHMEM, CAF, UPC
The following features are fixed in Cray DSMML 0.3.1 when compared
to Cray DSMML 0.3.0:
- Add support for differnt build env (RHEL, SLES 15 SP6)
Refer intro_dsmml(3) manpage for more information on the supported features
and syntax for different routines
Product and OS Dependencies:
----------------------------
The Cray DSMML 0.3.1 release is supported on the following
Cray systems:
* HPE Cray EX systems with CLE
Product and OS Dependencies by network type:
--------------------------------------------------+
| Shasta |
----------------------------+---------------------+
craype | >= 2.7.3 |
----------------------------+---------------------+
One or more compilers:
* AOCC 2.2 or later
* CCE 9.1 or later
* GNU 9.1 or later
* Intel 19.0 or later
* Nvidia 20.7 or later
Documentation:
--------------
Use the Cray DSMML man pages for more information on the library
functions and use intro_dsmml(3) man page for general information.
Use https://pe-cray.github.io/whitepapers/ for access to different
Cray DSMML specific whitepapers
Announcements, release informations, supported environments, and backward
compatibility informations about this product can be viewed in the following
location: https://pe-cray.github.io/cray-dsmml/
Modulefile:
-----------
module load cray-dsmml/0.3.1
Certain components, files or programs contained within this package or
product have the following Copyright:
Copyright 2018-2021,2024-2025 Hewlett Packard Enterprise Development LP.
Cray Dyninst 12.3.5
cray-dyninst 12.3.5
================================================================================
Product Description
---------------------------
- cray-dyninst provides tools for binary instrumentation, analysis, and modification.
Changelog
---------------------------
=======================================================================
## [12.3.5]
=======================================================================
### Features
* Add build for rhel 9.5; remove build for rhel 8.9 and sles15sp4
* Support rhel 8.10
* Build on sles15sp6 and rhel9.4
=======================================================================
## [12.3.2]
=======================================================================
### Features
* PE-51960: Added support for rhel89/93 & gcc13
=======================================================================
## [12.3.1]
=======================================================================
### Features
* Use gcc toolset 12 on redhat
OS Dependencies
---------------------------
- HPE CSM systems with SLES 15 SP5 - SP6
- HPE HPCM systems with SLES 15 SP5 - SP6 or RHEL 8.10 - 9.4
- HPE Apollo systems with RHEL 8.10
Product Dependencies
---------------------------
- cdst-support >= 2.14, < 3 installed
Documentation
---------------------------
- https://github.com/dyninst/dyninst
Installation Instructions
---------------------------
- rpm -ivh cray-dyninst-12.3.5-20250124222508_9cd2f6dcfbb7-72.el9.x86_64.rpm
To make this the default version of cray-dyninst, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_cray-dyninst_12.3.5
Legal Notices
---------------------------
Certain components, files or programs contained within this package or product are Copyright 2007-2025 Hewlett Packard Enterprise Development LP.
Attribution notices for open source licensed software for this package are detailed in the file:
/opt/cray/pe/dyninst/12.3.5/ATTRIBUTIONS_dyninst.txt
Cray LibSci 25.03.0
Cray LibSci 25.03.0
=====================
Purpose:
--------
Cray LibSci 25.03.0 provides scientific libraries for Cray
HPC systems. Cray LibSci is supported on the host CPU but
not on the accelerator of these systems.
The Cray LibSci 25.03.0 release provides updated support for
the following:
* SLES 15 SP6 (aarch64)
* RHEL 9.5 (x86_64 and aarch64)
* AMD ROCm 6.3
* Intel oneAPI 2025.0.0
* AMD AOCC 5.0
* Nvidia HPC SDK 24.11
* GCC 14
Cray LibSci 25.03.0 includes the following versions of publicly
available libraries:
* LAPACK 3.10.1 - For further information, see
http://www.netlib.org/lapack
* ScaLAPACK 2.2.0 - (Scalable LAPACK) For further information, see
http://www.netlib.org/scalapack.
* QDWH 2.0.0 KSVD 1.0.0 - Polar decomposition and SVD packages, see
https://github.com/ecrc/qdwh
https://github.com/ecrc/ksvd
Key Changes and Bugs Closed:
----------------------------
Changes in Cray LibSci 25.03.0
* Support for Intel Emerald Rapids
* CAST-36293 - Issue calling CGEMM with multiple threads
Changes in Cray LibSci 24.11.0
* Support for AMD MI300A and Turin
* Miscellaneous bug fixes
Changes in Cray LibSci 24.07.0
* Miscellaneous bug fixes
* Enabled module to set LD_LIBRARY_PATH when PE_LD_LIBRARY_PATH=system
* Removed Iterative Refinement Toolkit (IRT) support
Changes in Cray LibSci 24.03.0
* CAST-34956 - Lua module environment variable issue
Changed in Cray LibSci 23.12.5
* CAST-33777 - LibSci mutex contention issue
* Removed support for Intel KNL
Product and OS Dependencies:
----------------------------
The Cray LibSci 25.03.0 release requires the following:
* SLES 15 SP5/SP6 or RHEL 8.10/9.4/9.5
* SLES 15 SP5 (x86_64 or aarch64)
* SLES 15 SP6 (x86_64 or aarch64)
* RHEL 8.10 (x86_64)
* RHEL 9.4 (x86_64 or aarch64)
* RHEL 9.5 (x86_64 or aarch64)
* cray-mpich/8.1.0 or later
Supported on the following HPE systems:
* HPE Cray EX systems with CLE
* HPE Cray XD systems with CLE
One or more of the following compiler major versions:
* CCE 17.x or later (SLES)
* CCE 18.x or later (RHEL)
* GCC 12.3 or later (SLES)
* gcc-toolset-10.3/11.2/12.2 (RHEL 8.10)
* gcc-toolset-11.2/12.2/13.1 (RHEL 9.4)
* gcc-toolset-12.2/13.2/14.2 (RHEL 9.5)
* AOCC 4.1.0 or later
* AMD ROCm 6.0.0 or later
* Intel 2025.0.0 or later
* Nvidia 23.11 or later (aarch64) and 23.3 or later (x86_64)
Notes and Limitations:
----------------------
OMP threaded versions:
The CrayPE 2.1.2 and later releases add support for link line generation
for the multi-threaded versions of the libsci library based on the OpenMP
flags the user specifies for each compiler:
* CCE by default links to the OpenMP LibSci library. CrayPE will link in
the serial version of LibSci when the CCE flag -hnoomp is used.
* GNU by default links serial LibSci library. CrayPE will link in the
OpenMP version of LibSci when the GNU flag -fopenmp is used.
* INTEL by default links serial LibSci library. CrayPE will link in the
OpenMP version of LibSci when the INTEL flag -qopenmp is used.
Stack size limit:
The 'ulimit -s unlimited' system stack size setting is required for
cray-libsci on all supported Cray platforms. This is typically set as a
system default by admin but may otherwise need to be set at runtime.
Non-default dynamic linking:
When using a non-default version of cray-libsci with dynamic linking
users should set at runtime and at linktime after loading the desired
cray-libsci module--or set the equivalent for their linux shell:
export LD_LIBRARY_PATH=$CRAY_LD_LIBRARY_PATH:$LD_LIBRARY_PATH
Documentation:
--------------
See the intro_libsci man page for additional information.
See the csmlversion man page for information to display version information
on the currently loaded scientific libraries.
Modulefile:
-----------
module load cray-libsci
Installation instructions:
--------------------------
LibSci is now packaged into separate compiler specific RPMs to allow
rpmbuild to correctly include compiler dependencies.
License:
--------
Except for the third party components and software licensed by HPE
through proprietary agreements, components, files or programs
contained within this package or product are Copyright 2001-2025
Hewlett Packard Enterprise Development LP.
Attribution notices for open source licensed software contained in this
package are detailed in the file:
/opt/cray/libsci/25.03.0/ATTRIBUTIONS
Cray LibSci for Accelerators 25.03.0
Cray LibSci_ACC 25.03.0
=======================
Purpose:
--------
The Cray LibSci_ACC 25.03.0 release provides accelerated versions of
scientific libraries for HPE Cray systems with accelerators.
Product and OS Dependencies:
----------------------------
Cray LibSci_ACC 25.03.0 requires the following platform:
HPE Cray EX system with AMD MI250X & MI300A
HPE Cray EX system with Nvidia A100 & H100
Cray LibSci_ACC 25.03.0 supports the following OS:
RHEL 8.10 x86_64
RHEL 9.4 x86_64 & aarch64
RHEL 9.5 x86_64 & aarch64
SLES 15SP6 x86_64 & aarch64
Notes and Limitations:
----------------------
LAPACK workspace calculations from other implementations or hard-coded
values may not be compatible with cray-libsci_acc. Workspaces reported from
a query to the corresponding cray-libsci_acc function should be used.
The current supported usecase is a one-rank to one-gpu mapping for apps.
Performance improvements can be achieved in programs calling cray-libsci_acc
subroutines by using pinned memory. See the intro_libsci_acc man page for
details.
Use of the aprun option "-cc none" or the srun option "--cpu_bind=none"
to disable core affinity is strongly suggested to maintain performance.
When using non-default cray-libsci_acc versions users should set equivalent
at runtime and linktime after loading the desired cray-libsci_acc module:
export LD_LIBRARY_PATH=$CRAY_LD_LIBRARY_PATH:$LD_LIBRARY_PATH
Documentation:
--------------
See the intro_libsci_acc man page for additional information.
Modulefile:
-----------
module load cray-libsci_acc
Sample Installation instructions:
---------------------------------
RPM install command:
rpm -ivh cray-libsci-acc-25.03.0-*.##ARCH##.rpm
The "*" in the install command represents compiler version combinations.
To make this the default version:
##PREFIX##/admin-pe/set_default_files/set_default_libsci_acc_25.03.0
License:
--------
Except for the third party modules and software licensed by HPE
through proprietary agreements, components, files or programs
contained within this package or product are Copyright -2025 Hewlett
Packard Enterprise Development LP.
Attribution notices for open source licensed software contained in
this package are detailed in the file:
##PREFIX##/libsci_acc/25.03.0/ATTRIBUTIONS_libsci_acc_25.03.0.txt
Cray Lmod 8.7.55
Cray Lmod 8.7.55
================================================================================
Release Date:
--------------------------------------------------------------------------------
March, 2025
Purpose:
--------------------------------------------------------------------------------
Provide a Lmod 8.7.55 package for CPE customers
Bugs fixed in this release:
--------------------------------------------------------------------------------
N/A
Documentation:
--------------------------------------------------------------------------------
See CPE's Installation and User Guides for documentation.
Also see Lmod's official website: https://lmod.readthedocs.io
Dependencies:
--------------------------------------------------------------------------------
The Lmod Scripts 8.7.55 release is dependent on the following
software:
bc
sed
lua >= 5.3
lua-luaposix
lua-luafilesystem
Installation instructions:
--------------------------------------------------------------------------------
rpm -Uvh cray-lmod-8.7.55-1.el9.x86_64.rpm
To make this the default version, update the symbolic "lmod" link
to the desired Lmod version directory.
Cray Lmod Scripts 3.2.1
Lmod Scripts 3.2.1
================================================================================
Release Date:
--------------------------------------------------------------------------------
December, 2023
Purpose:
--------------------------------------------------------------------------------
Updates package license.
Bugs fixed in this release:
--------------------------------------------------------------------------------
Documentation:
--------------------------------------------------------------------------------
See system Installation and User Guides for documentation
Dependencies:
--------------------------------------------------------------------------------
The Lmod Scripts 3.2.1 release is dependent on the following
software:
set_default_3
Lua
Lmod
Installation instructions:
--------------------------------------------------------------------------------
rpm -Uvh lmod_scripts-3.2.1-202501040204.4e8c22a6028d4-0.noarch.rpm
To make this the default version, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_lmod_scripts_3.2.1
Product description:
--------------------------------------------------------------------------------
Contains Lua scripts which support the Cray implementation of Lmod
Copyright 2020-2023 Hewlett Packard Enterprise Development LP
Cray MRNet 5.1.5
cray-mrnet 5.1.5
================================================================================
Product Description
---------------------------
- MRNet is a customizable, high-performance software infrastructure for
building scalable tools and applications. It supports efficient
multicast and data aggregation functionality using a tree of processes
between the tool's front-end and back-ends. MRNet-based tools may use
these internal processes to distribute many important tool activities,
for example to reduce data analysis time and keep tool front-end loads
manageable.
MRNet-based tool components communicate across logical channels called
streams. At MRNet internal processes, filters are bound to these streams to
synchronize and aggregate dataflows. Using filters, MRNet can efficiently
compute averages, sums, and other more complex aggregations and analyses
on tool data. MRNet also supports facilities that allow tool developers
dynamically load new tool-specific filters into the system.
Changelog
---------------------------
=======================================================================
## [5.1.5]
=======================================================================
### Features
* Add rhel 9.5, remove rhel 8.9 and sles15sp4
=======================================================================
## [5.1.4]
=======================================================================
### Features
* Build rpms for rhel 8.10
* Build on rhel 9.4 and sles15sp6
=======================================================================
## [5.1.3]
=======================================================================
### Features
* PE-51960: Added support for rhel89/93 & gcc13
OS Dependencies
---------------------------
- HPE CSM systems with SLES 15 SP5 - SP6
- HPE HPCM systems with SLES 15 SP5 - SP6 or RHEL 8.10 - 9.4
- HPE Apollo systems with RHEL 8.10
Product Dependencies
---------------------------
- cray-cti >= 2.19, < 3 installed
- cdst-support >= 2.14, < 3 installed
Installation Instructions
---------------------------
- rpm -ivh cray-mrnet-5.1.5-20250113163051_92846a94dd12-57.el9.x86_64.rpm
To make cray-mrnet 5.1.5 the default version of cray-mrnet, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_cray-mrnet_5.1.5
Legal Notices
---------------------------
Certain components, files or programs contained within this package or product are Copyright 2022-2025 Hewlett Packard Enterprise Development LP.
Attribution notices for open source licensed software for this package are detailed in the file:
/opt/cray/pe/mrnet/5.1.5/ATTRIBUTIONS_mrnet.txt
Cray OpenSHMEMX 11.7.4
Cray OpenSHMEMX 11.7.4:
===============================
Release Date:
-------------
March, 2025
Purpose:
--------
OpenSHMEM is a Partitioned Global Address Space (PGAS) library interface
specification, which is the culmination of a standardization effort among
many implementers and users of SHMEM programming model. SHMEM has a long
history as a parallel programming model on HPE Cray supercomputer systems.
For the past two decades SHMEM library implementation in HPE Cray systems
evolved through different generations. Cray OpenSHMEMX is a proprietary,
OpenSHMEM specification compliant SHMEM implementation for HPE Cray
product line.
Key Changes:
------------
Major differences in Cray OpenSHMEMX 11.7.4 from
Cray OpenSHMEMX version 11.7.3 includes the following:
- Improve multithreaded performance of quiet and blocking PUTs
- Add support for DSMML version 0.3.1
Bugs Closed:
------------
The following bugs are fixed as part of the Cray OpenSHMEMX 11.7.4
release:
- Fix cartesian layout for split-2D OpenSHMEM Team creation
- Fix support for using multiple session flags
Product and OS Dependencies:
----------------------------
The Cray OpenSHMEMX 11.7.4 release is supported on the following
Cray systems:
* HPE Cray EX systems with CLE
Product and OS Dependencies by network type:
--------------------------------------------------+
| HPE Slingshot |
----------------------------+---------------------+
craype | >= 2.7.3 |
----------------------------+---------------------+
cray-pals | >= 0.3.5 |
----------------------------+---------------------+
cray-pmi | >= 6.0.1 |
----------------------------+---------------------+
libfabric | >= 1.9.0 |
----------------------------+---------------------+
cray-dsmml | >= 0.2.2 |
----------------------------+---------------------+
One or more compilers:
* AOCC 2.2 or later
* CCE 9.1 or later
* GNU 9.1 or later
* Intel 19.0 or later
* Nvidia 20.7 or later
Notes and Limitations:
----------------------
Announcements, release information, supported environments, limitations,
usage models, and backward compatibility informations about this product
can be viewed in the following location:
https://pe-cray.github.io/cray-openshmemx/
Documentation:
--------------
Use the Cray OpenSHMEMX man pages for more information on the library
functions and use intro_shmem(3) man page for general information.
Initial support for Cray OpenSHMEMX man pages are derived from OpenSHMEM
standards specification document
Use https://pe-cray.github.io/whitepapers/ for access to different
Cray OpenSHMEMX specific whitepapers
Modulefile:
-----------
module load cray-openshmemx/11.7.4
License:
--------
Components, files, and programs contained within this package or
product are Copyright Hewlett Packard Enterprise Development LP
Cray PAPI 7.2.0.1
cray-papi
=================
Release date:
-------------
March 2025
Package:
--------
cray-papi-7.2.0.1-202412042041.2a6ab8c87a3d1-2 x86_64
Purpose:
--------
New version of papi 7.2.0.1 release 2
Documentation:
--------------
Overview: https://github.com/icl-utk-edu/papi
Web Site: https://icl.utk.edu/papi
Product description:
--------------------
PAPI aims to provide the tool designer and application engineer with a
consistent interface and methodology for use of the performance counter
hardware found in most major microprocessors. PAPI enables software
engineers to see, in near real time, the relation between software
performance and processor events.
Dependencies:
-------------
For a list of software used when validating this version of
PAPI on Cray and HPE systems, see the HPE Cray Programming
Environment release announcements.
Copyright 2015-2017,2019-2024 Hewlett Packard Enterprise Development LP
Cray PE Targets 1.15.1
CrayPE Targets 1.15.1
================================================================================
Release Date:
--------------------------------------------------------------------------------
March, 2025
Purpose:
--------------------------------------------------------------------------------
Updates hugepage module values
Bugs fixed in this release:
--------------------------------------------------------------------------------
None
Dependencies:
--------------------------------------------------------------------------------
The CrayPE Targets 1.15.1 release is dependent on the following
software products:
CrayPE
set_default_3
lmod_scripts
Documentation:
--------------------------------------------------------------------------------
See manpages for cc, CC, ftn, intro_craype-api and pkg-config
See section 2.6 Using Targeting Modules of the Cray Programming Environment
User's Guide (S-2529-116)
See http://www.freedesktop.org/wiki/Software/pkg-config for a pkg-config
introduction.
Installation instructions:
--------------------------------------------------------------------------------
rpm -Uvh craype-targets-ex-hpcm-1.15.1-202501160316.6d6160492a8b7-0.ex.hpcm.noarch.rpm
To make this the default version, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_craype-targets_1.15.1-tcl
/opt/cray/pe/admin-pe/set_default_files/set_default_craype-targets_1.15.1-lua
Product description:
--------------------------------------------------------------------------------
CrayPE Targets contains the modules for CrayPE targets.
TCL Modules - craype-accel-host craype-accel-amd-gfx90a craype-accel-amd-gfx908 craype-accel-amd-gfx940 craype-accel-amd-gfx942 craype-accel-intel-max craype-accel-nvidia70 craype-accel-nvidia80 craype-accel-nvidia90 craype-hugepages2M craype-hugepages4M craype-hugepages8M craype-hugepages16M craype-hugepages32M craype-hugepages64M craype-hugepages128M craype-hugepages256M craype-hugepages512M craype-hugepages1G craype-hugepages2G craype-arm-grace craype-x86-milan craype-x86-milan-x craype-x86-rome craype-x86-spr craype-x86-spr-hbm craype-x86-trento craype-x86-turin craype-x86-genoa craype-network-none craype-network-ofi craype-network-ucx
Lmod Modules - craype-accel-host craype-accel-amd-gfx90a craype-accel-amd-gfx908 craype-accel-amd-gfx940 craype-accel-amd-gfx942 craype-accel-intel-max craype-accel-nvidia70 craype-accel-nvidia80 craype-accel-nvidia90 craype-hugepages2M craype-hugepages4M craype-hugepages8M craype-hugepages16M craype-hugepages32M craype-hugepages64M craype-hugepages128M craype-hugepages256M craype-hugepages512M craype-hugepages1G craype-hugepages2G craype-arm-grace craype-x86-milan craype-x86-milan-x craype-x86-rome craype-x86-spr craype-x86-spr-hbm craype-x86-trento craype-x86-turin craype-x86-genoa craype-network-none craype-network-ofi craype-network-ucx
Copyright 2013-2023 Hewlett Packard Enterprise Development LP
Cray PMI 6.1.15
Cray PMI 6.1.15
==============================================================================
Release Date:
--------------
May 30, 2024
Purpose:
--------
The Cray Process Manager Interface Library provides the interface between the
application launcher and other communication libraries such as MPICH and SHMEM.
Cray PMI 6.1.15 is optimized for the Cray Programming Environment.
New Cray PMI features for HPE Cray EX and Apollo systems:
Key Changes and Bugs Closed:
----------------------------
Starting with Cray-PMI 6.1.0 the cray-pmi and cray-pmi-lib modules have been
combined into a single cray-pmi module. The cray-pmi-lib module will no longer
be installed by new cray-pmi rpms. When the cray-pmi module is loaded, the
pmi libraries will be linked with as-needed flags.
Bug fixes new to Cray PMI 6.1.15 include:
- PE-52482 - Bugfix for jobs using MPICH_RANK_REORDER_DISPLAY=1
- PE-53689 - Enable module to set LD_LIBRARY_PATH when PE_LD_LIBRARY_PATH=system
Product and OS Dependencies:
----------------------------
The Cray PMI 6.1.15 release is supported on the following systems:
* HPE Cray EX systems with CLE
* HPE Apollo systems as part of the Cray Programming Environment
Product Dependencies:
----------------------------------------+
cray-pals | >= 1.0.6 |
-----------------------+----------------+
slurm | >= 20.02 |
-----------------------+----------------+
Notes and Limitations:
----------------------
Documentation:
--------------
For more information see the intro_pmi man page.
Modulefile:
-----------
module load cray-pmi/6.1.15
License:
--------
Except for the third party components and software licensed by HPE
through proprietary agreements, components, files or programs contained
within this package or product are Copyright 2020-2021 Hewlett Packard
Enterprise Development LP.
Attribution notices for open source licensed software for this
package are detailed in the file:
/opt/cray/pe/pmi/6.1.15/ATTRIBUTIONS
Cray Python 3.11.7
cray-python 3.11.7
====================
Release Date
------------
July 2024
Purpose
-------
Cray Python is an implementation of the Python programming language for the Cray
Programming Environment. The numpy and scipy modules are configured to call Cray
Libsci routines. The mpi4py module is configured to call Cray MPICH routines.
Cray Python is designed to run Python codes on the compute nodes of an HPE
supercomputer. HPE does not make changes to the Python source or any of its
libraries nor does it plan to make changes in future releases.
The cray-python 3.11.7 release contains
- python-3.11.7
- numpy-1.24.4
- scipy-1.10.1
- mpi4py-3.1.4
- dask-2023.6.1
Product and OS Dependencies
---------------------------
The cray-python 3.11.7 release is supported on
- Cray EX systems running SLES 15 or RHEL 8
Documentation
-------------
https://www.python.org/doc
Changelog
---------
https://docs.python.org/release/3.11.7/whatsnew/changelog.html
Modulefile
----------
module load cray-python/3.11.7
Installation
------------
rpm -ihv cray-python-3.11.7-20240617153005.0687944-1.el9.x86_64.rpm
To make this the default version, execute
[PREFIX]/admin-pe/set_default_files/set_default_python_3.11.7
Certain components, files, or programs contained within this package are
© Copyright 2021-2024 Hewlett Packard Enterprise Development LP
Cray R 4.4.0
cray-R 4.4.0
============
Release Date
------------
March 2024
Purpose
-------
The cray-R 4.4.0 release.
cray-R is configured to call cray-libsci routines.
Product and OS Dependencies
---------------------------
The cray-R 4.4.0 release is supported on
- Cray EX systems running SLES 15 or RHEL 8
Documentation
-------------
https://cran.r-project.org/manuals.html
Modulefile
----------
module load cray-R/4.4.0
Installation
------------
rpm -ihv cray-R-4.4.0-20240617153123.a134495-1.el9.x86_64.rpm
To make this the default version, execute:
[PREFIX]/admin-pe/set_default_files/set_default_R_4.4.0
Certain components, files or programs contained within this package or product are
Copyright 2018-2024 Hewlett Packard Enterprise Development LP
Cray Stat 4.12.5
cray-stat 4.12.5
================================================================================
Product Description
---------------------------
- The Stack Trace Analysis Tool (STAT) is a highly scalable, lightweight
tool that gathers and merges stack traces from all of the processes of
a parallel application to form call graph prefix trees.
Notes
---------------------------
- To enable gathering stack traces on an Nvidia GPU, the environment variable
STAT_GDB must be set to either cuda-gdb, which will require cuda-gdb to be
available in PATH. Or it can be set a specific debugger. We suggest the
version of cuda-gdb packaged with gdb4hpc, as in:
export STAT_GDB=/opt/cray/pe/gdb4hpc/$GDB4HPC_VERSION/libexec/cuda110-gdb-guard
After which stat-cl would be called using the options: -w -G -i
Changelog
---------------------------
=======================================================================
## [4.12.5]
=======================================================================
### Bug Fixes
* CPE-5994: Use Flux attach, diagnostics when Flux cannot initialize
### Features
* Build with g++14 on rhel 9.5 and sles15sp6
* Add rhel 9.5, remove rhel 8.9 and sles15sp4
=======================================================================
## [4.12.4]
=======================================================================
### Features
* Support rhel 8.10
* Build on rhel 9.4 and sles15sp6
* PE-53556: STAT dotfiles compatible with other dotfile viewers
=======================================================================
## [4.12.3]
=======================================================================
### Features
* PE-51960: Added support for rhel89/93 & gcc13
* Update to gcc toolset 12 on redhat
* Update to gcc toolset 12 on redhat
OS Dependencies
---------------------------
- HPE CSM systems with SLES 15 SP5 - SP6
- HPE HPCM systems with SLES 15 SP5 - SP6 or RHEL 8.10 - 9.4
- HPE Apollo systems with RHEL 8.10
Product Dependencies
---------------------------
- cray-mrnet >= 5.1, < 6 installed
- cray-cti 2.19, < 3 installed
- cdst-support >= 2.14, < 3 installed
Documentation
---------------------------
- https://computing.llnl.gov/code/STAT/
Installation Instructions
---------------------------
- rpm -ivh --oldpackage cray-stat-4.12.5-20250113163254_72ee536917a7-74.el9.x86_64.rpm
To make cray-stat 4.12.5 the default version of cray-stat, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_cray-stat_4.12.5
Legal Notices
---------------------------
Certain components, files or programs contained within this package or product are Copyright 2007-2025 Hewlett Packard Enterprise Development LP.
Attribution notices for open source licensed software for this package are detailed in the file:
/opt/cray/pe/stat/4.12.5/ATTRIBUTIONS_stat.txt
Cray zmqnet 1.3.0
cray-zmqnet 1.3.0
================================================================================
Product Description
---------------------------
- zmqnet is a library for creating a network tree between applications
and HPC jobs using zmq.
Changelog
---------------------------
=======================================================================
## [1.3.0]
=======================================================================
### Bug Fixes
* CPE-7182: Remove TimeoutAfterLast from variant, create non-variant interface
* Missing apollo install yamls PE-55041
* PE-54822: Throw exception when fail to detect hostname
* PE-53720: Include capnp tools in support directory
* PE-53603: Show diagnostic when libsodium cannot be loaded
* PE-51694: Make pings thread safe
* PE-51165: Assign rank and PID in packed mode
* PE-49776: Check TMPDIR before using it
* PE-49611: Detect spurious timeouts and fix backend timeout setting
* PE-48636: Remove message traversal limit
* Fix install path exported by lmod modulefile on relocated install
* PE-45208: Don't remove auth keyfile until setup completed
* Fix rarely dropped messages during startup
* Ensure nodes in newly created communicators are fully connected before returning new communicator to user
### Features
* Build with g++ 14 on rhel 9.5 and sles15sp6
* Add rhel 9.5, remove rhel 8.9 and sles15sp4
* CPE-6082: Configurable backend timeout for flushing messages before exit
* PE-5880: Add Timeout After Last synchronization option
* Build rpms for rhel 8.10
* Build on sles sp6 and rhel 9.4
* PE-53605: Build and package libsodium dependency
* PE-51960: Added support for rhel89/93 & gcc13
* PE-44112: Add optional heartbeat monitor thread to AsyncFrontend
* PE-50464: Implement configurable port base
* Move to gcc-toolset-12 on redhat
* PE-48567: ZMQNet documentation
* Introduce forceDisconnect function to AsyncFrontend
* PE-41205: Add option to disable encryption at build and run time
=======================================================================
## [1.0.0] - 2022-9-26 (22.10)
=======================================================================
* Initial release
OS Dependencies
---------------------------
- HPE CSM systems with SLES 15 SP5 - SP6
- HPE HPCM systems with SLES 15 SP5 - SP6 or RHEL 8.10 - 9.4
- HPE Apollo systems with RHEL 8.10
Product Dependencies
---------------------------
- cray-cti 2.19, < 3 installed
- cdst-support >= 2.14, < 3 installed
Installation Instructions
---------------------------
- rpm -ivh cray-zmqnet-1.3.0-20250124234801_7eea1453a40a-99.el9.x86_64.rpm
To make cray-zmqnet 1.3.0 the default version of cray-zmqnet, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_cray-zmqnet_1.3.0
Legal Notices
---------------------------
Certain components, files or programs contained within this package or product are Copyright 2020-2025 Hewlett Packard Enterprise Development LP.
Attribution notices for open source licensed software for this package are detailed in the file:
/opt/cray/pe/zmqnet/1.3.0/PLACEHOLDER_ATTRIBUTIONS_zmqnet.txt
Craypkg-gen 1.3.35
Craypkg-gen 1.3.35
==============
Release date
------------
January 2025
Purpose
-------
Bug fix release.
Bugs fixed in this release
--------------------------
- Update intel modulefile to use ifx instead of ifort for 2025.0 and later
Dependencies
------------
The craypkg-gen 1.3.35 release is supported on the following HPE
Cray systems:
- Cray EX systems SLE 15.0 or later and RHEL 8.0 or later.
Driver support for integrating Third Party C, C++, and Fortran libraries
through .pc files using pkg-config is used in CrayPE 2.x and later.
Limitation
----------
- Library dependencies for static libraries are not added to the .pc files
for keywords Requires.private and Libs.private. A warning is issued by
the craypkg-gen tool to advise users to add this information to the
libraries .pc files.
- RPM limits packages to 4GB
Documentation
-------------
Man pages for craypkg-gen are found by executing `module load craypkg-gen`
and then `man craypkg-gen`. See
http://www.freedesktop.org/wiki/Software/pkg-config for a pkg-config
introduction.
Examples for creating modulefiles for Intel, PGI and Python are included in
the craypkg-gen ‘doc’ directory:
/opt/cray/craypkg-gen/1.3.35/doc/intel_example.txt
/opt/cray/craypkg-gen/1.3.35/doc/pgi_example.txt
/opt/cray/craypkg-gen/1.3.35/doc/python_example.txt
Example:
- As an example, the Intel 16.0.3.210 compiler was recently released.
After installing the compiler the administrator creates a modulefile for
this release by executing the following commands:
# module load craypkg-gen
# craypkg-gen -m /opt/intel/compilers_and_libraries_2016.3.210
This version of the Intel compiler is made default by executing the
command:
# /opt/admin-pe/set_default_craypkg/set_default_intel_16.0.3.210
Installation instructions
-------------------------
rpm -ivh craypkg-gen-1.3.35-1.3.35.4.gb93efea-1.el9.noarch.rpm
To change the product version to default after installation:
/opt/cray/pe/admin-pe/set_default_files/set_default_craypkg-gen_1.3.35
Product description
-------------------
The craypkg-gen 1.3.35 utility provides the system administrator
a tool to integrate third party software with the Cray software stack.
Craypkg-gen assists with integration by creating .pc files for C, C++, and
Fortran libraries, pkg-config enabled modulefiles and RPMs.
The workflow for using craypkg-gen is
1) Build the open source software
2) Create .pc files for libraries
3) Create pkg-config enabled modulefiles
4) Customize pkg-config and modulefiles if needed
Certain components, files or programs contained within this package or product
are Copyright 2013-2024 Hewlett Packard Enterprise Development LP.
FFTW 3.3.10.10
FFTW 3.3.10.10
============
Purpose:
--------
This Cray FFTW 3.3.10.10 release is supported on HPE/Cray EX and
HPE/Cray XD/Apollo systems with x86-64 CPUs. Cray FFTW is supported
on the host CPU but not on the accelerator of HPE/Cray systems.
The Cray FFTW 3.3.10.10 release provides the following:
- Compiler and dependency updates
See the Product and OS Dependencies section for details.
Product and OS Dependencies:
----------------------------
This Cray FFTW 3.3.10.10 release is supported on these HPE/Cray systems:
- HPE/Cray EX Systems with SLES 15 SP6 or later, RHEL 8.10, or RHEL 9.4 or later based OS
- HPE/Cray XD/Apollo Systems with RHEL 8.10 or RHEL 9.4 or later based OS
This Cray FFTW 3.3.10.10 release requires the following software products:
craype 2.7.32 or later
cray-mpich 8.1.30 or later
One or more of the following major compiler versions:
CCE 19
GCC 14
AOCC 5
AMD (ROCm) 6
Intel 2025
Notes and Limitations:
----------------------
Starting with cray-fftw/3.3.6.1 the fftw module has been renamed from fftw
to cray-fftw.
Documentation:
--------------
http://www.fftw.org/index.html#documentation
See the intro_fftw3 manual page for additional information.
Modulefile:
-----------
module load cray-fftw
Installation
------------
To install the rpm, execute:
rpm -ivh cray-fftw-3.3.10.10-202502042104.fd1b38cd0bf15-1.el9.x86_64.rpm
To make this the default version, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_fftw_3.3.10.10
Certain components, files or programs contained within this package or
product are Copyright 2011-2024 Hewlett Packard Enterprise Development LP
Forge 24.1.1
forgesup 24.1.1
================================================================================
Product Description
---------------------------
- Provides the HPE Forge support package which contains modulefiles (tcl & lua),
set_default files, and content projection files for Forge 24.1.1.
- The only supported install directory for forgesup is /opt/cray/pe.
- The only supported install directory for Lenaro forge is /opt/forge.
- Drop the license file into: /opt/forge/24.1.1/
- Currently, forge-24.1.1 by default drops logfiles into the $HOME directory
which is not projected on a EX system. In order for forge-24.1.1 to successfully
launch an application on EX perform the following configuration:
export ALLINEA_SESSION_PATH=ProjectedDirectory
e.g:
export ALLINEA_SESSION_PATH=/lus/USERNAME
Changelog
---------------------------
=======================================================================
## [24.1.1]
=======================================================================
### Features
* Release as noarch rpm
* Build package as noarch
=======================================================================
## [23.1.2]
=======================================================================
### Features
* PE-53213: Updated Forgesup to support Forge 23.1.2
=======================================================================
## [23.1]
=======================================================================
### Features
* PE-49958: Implemented Auto-gen release notes/changelog tool
* Updated supported version to 23.1
OS Dependencies
---------------------------
- HPE CSM systems with SLES 15 SP4
- HPE HPCM systems with SLES 15 SP5 and RHEL 8.8
- HPE Apollo systems with RHEL 8.8
Product Dependencies
---------------------------
- This forgesup 24.1.1 package has a dependency on Forge 24.1.1.
Documentation
---------------------------
- The Forge user guide can be found in /opt/forge/24.1.1/doc/userguide-forge.pdf
- The Forge release notes can be found in /opt/forge/24.1.1/doc/RELEASE-NOTES
- The Forgesup release notes can be found in /opt/cray/pe/forgesup/24.1.1/
Installation Instructions
---------------------------
- rpm -ivh forgesup-24.1.1-20250108224654_9ae4bf55b047-45.<ARCH>.rpm
To make forge 24.1.1 the default version, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_forge_24.1.1
Legal Notices
---------------------------
Copyright 2007-2025 Hewlett Packard Enterprise Development LP.
gdb4hpc 4.16.4
gdb4hpc 4.16.4
================================================================================
Product Description
---------------------------
- gdb4hpc is a GDB-based parallel debugger used to debug applications compiled with
CCE, AOCC, GNU, and Intel Fortran, C and C++ compilers. It allows programmers to
either launch an application or attach to an already running application that
was launched on the system. Additionally, it provides comparative debugging
technology that enables programmers to compare data structures between two
executing applications. Comparative debugging should be used in conjunction
with the CCDB GUI tool accessed by loading the cray-ccdb module.
- Some features of gdb include:
* Command line parallel debugger allows for launching/attaching applications.
* Utilizes process sets to operate on a subset of application ranks.
* GDB-like feel, also implements a gdbmode to enable a true parallel gdb.
* GPU debugging is supported for OpenMP 4.0+ GPU directives; OpenMP 5.0 on AMD
and Nvidia GPU's.
* Workload manager support via Common Tools Interface (cray-cti).
Changelog
---------------------------
=======================================================================
## [4.16.4]
=======================================================================
### Bug Fixes
* CPE-6196: Allow CUDA breakpoints on kernel launch
* Print NaN and infinity values
* Add RUNPATH for unit tests to libexec/dbgsrv
* CPE-5982: Fix cuda command failures in some cases
* CPE-5960: Fix failure to launch application when using certain acceleration runtimes
* No not generate missing MPI breakpoint if a program use mpi_init_thread
* PE-52432: Load MRNet filter library from complete path
* PE-54147: Use main function from debug information
* Fix printing std::unique_ptr with newer stdc++
* Fix print of character arrays shorted by set print elements
* Fix backend gdb crash on vector<vector<string>>
### Features
* CPE-7286: Support basic list command in python mode
* CPE-7395: Support 'catch throw' and 'catch raise' commands in python mode
* CPE-6731: Apply pager setting to results of `info threads` command
* CPE-5688: In python mode, stop the application on uncaught exceptions
* CPE-635: Verify python breakpoint locations
* CPE-6345: Add --pending option to break
* CPE-5686: Add frame and up/down commands to python mode
* CPE-6994: Handle unregistered breakpoints and watchpoints
* CPE-6094: Support setting breakpoints in multithreaded python apps
* Add rhel 9.5, remove rhel 8.9 and sles15sp4
* CPE-6664: Support debugging python 3.5, python 3.7, python 3.13
* CPE-6561: Improve CUDA API error reporting
* CPE-6513: Show cuda-gdb cuda API warnings
* CPE-5690: Change command prompt when in python mode
* CPE-6037: Add GPU debugging tutorial
* CPE-615: Add python mode documentation
* CPE-2316: Add "what's new in 4.16.3" document
* CPE-633: support finish command in python mode
* CPE-2350: Autocomplete struct members for `print`
* PE-53102: Set python breakpoints and step/next in python
* Support rhel 8.10
* Add builds for rhel 9.4 and sles15sp6
* PE-53101: Evaluate python statements with the print command
* PE-55035: Python mode and python backtraces
* PE-53105: Launch applications with the same syntax as an srun command
* PE-54824: Support non-MPI PALS launches
* PE-54073: Print job output on failed launch
* PE-53771: Pass arguments to launched app on the end of the launch command
=======================================================================
## [4.16.2]
=======================================================================
### Bug Fixes
* PE-52737: Fix backend crash when debugging Intel OneAPI GPUs
### Features
* PE-47910: Run job cleanup in background
* PE-53716: Added user guide for using the Python gdb extension
* PE-51960: Added support for rhel89/93 & gcc13
* PE-53828: Implement Flux attach
* Automatically load python extensions when debugger starts
* PE-53100: Support for aggregated gdb python extension commands py-print and py-locals if underlying gdb has python extensions loaded
* PE-53100: Support for aggregated gdb python extension commands py-bt, py-list, py-up, and py-down if underlying gdb has python extensions loaded
* Handle "~" in the --debug launch argument
* PE-52589: Tweak default assertion script behavior - now assertion scripts stop iff an assertion fails default
* PE-51936: Added tab completion for the print command
=======================================================================
## [4.16.1]
=======================================================================
### Bug Fixes
* PE-52387: Fix segfault from list command
* PE-51694: Fix occasional crash when operating on a subset of ranks
* PE-44112: Track job status while running for quicker timeout and exit
* Fix recursive source command behavior
* Properly format /csv output with data over 1 million items
* PE-51165: Query ZMQNet for correct rank and target PID
### Features
* PE-51935: Tab completion with file names when setting breakpoints
* PE-51935: Tab completion with function names when setting breakpoints
* PE-50319: Improve feedback when switching command modes
* PE-51749: Tab completion for help, set, show commands
* PE-51752: Moved vscode plugin to gdb4hpc and packaged executable
* PE-51598: Add save all command
* PE-51254: Save and restore assertion scripts and decompositions
* PE-51253: Save and restore breakpoints
* Update included hpcc_demo
* Add set print value-caching
* Save decomposition values as convenience variables
OS Dependencies
---------------------------
- HPE CSM systems with SLES 15 SP5 - SP6
- HPE HPCM systems with SLES 15 SP5 - SP6 or RHEL 8.10 - 9.4
- HPE Apollo systems with RHEL 8.10
Product Dependencies
---------------------------
- cray-mrnet >= 5.1, < 6 installed
- cray-cti 2.19, < 3 installed
- cdst-support >= 2.14, < 3 installed
Documentation
---------------------------
- Type `man gdb4hpc` with the gdb4hpc module loaded to read the gdb4hpc(1) man page.
Simple usage examples are provided at the end.
Also, type `help` at the gdb4hpc command line for more information on commands.
Installation Instructions
---------------------------
- rpm -ivh gdb4hpc-4.16.4-20250113161518_894e3ff4cf4c-415.el9.x86_64.rpm
To make gdb4hpc 4.16.4 the default version of gdb4hpc, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_gdb4hpc_4.16.4
Legal Notices
---------------------------
Certain components, files or programs contained within this package or product are Copyright 2007-2025 Hewlett Packard Enterprise Development LP.
Attribution notices for open source licensed software for this package are detailed in the file:
/opt/cray/pe/gdb4hpc/4.16.4/ATTRIBUTIONS_gdb4hpc.txt
HDF5 1.14.3.5
# HDF5 1.14.3.5
## Purpose:
This HDF5 release contains the following:
* SLES 15 SP6 (x86_64, aarch64)
* RHEL 9.4 (x86_64, aarch64)
* RHEL 9.5 (x86_64, aarch64)
* RHEL 8.10 (x86_64)
* Apollo RHEL 8.10 (x86_64)
* CCE 19.0.0
* AMD ROCm 6.3
* AOCC 5.0
* Intel OneAPI 2025.0.0
* Nvidia HPC SDK 24.11
* GCC 14
## Product and OS Dependencies:
The HDF5 1.14.3.5 release is supported on the following systems, requiring the following software products:
* CrayPE 2.1.2 or later
* SLES 15 SP6 (x86_64, aarch64)
* RHEL 8.10 (x86_64)
* Apollo RHEL 8.10 (x86_64)
* RHEL 9.4 (x86_64, aarch64)
* RHEL 9.5 (x86_64, aarch64)
* cray-mpich/8.1.0 or later
Supported on the following HPE systems:
* HPE Cray EX systems with CLE
* HPE Cray XD systems with CLE
One or more of the following compiler major versions:
* CCE 18.x or later (SLES, RHEL)
* GCC 12.3 or later (SLES)
* gcc-toolset-10.3/11.2/12.2 (RHEL 8.10)
* gcc-toolset-11.2/12.2/13.1 (RHEL 9.4)
* gcc-toolset-12.2/13.2/14.2 (RHEL 9.5)
* AOCC 4.2.0 or later
* AMD ROCm 6.2.1 or later (SLES and RHEL) or AMD ROCm 6.2 or later (Apollo RHEL 8.10)
* Intel 2024.2.0 or later
* Nvidia 23.11 or later (aarch64) and 23.3 or later (x86_64)
## Notes and Limitations:
Users are encouraged to use the Cray compiler scripts (cc, ftn, CC) to include the HDF5 header files and link in the HDF5 libraries, rather than the HDF5 compiler scripts (h5cc, h5fc, h5c++) included in the release.
## Documentation:
http://www.hdfgroup.org/HDF5/doc/index.html
## Modulefile:
`module load cray-hdf5`
OR
`module load cray-hdf5-parallel`
## Product description:
HDF5 is a data model, library, and file format for storing and managing data. It supports an unlimited variety of datatypes, and is designed for flexible and efficient I/O and for high volume and complex data. HDF5 is portable and is extensible, allowing applications to evolve in their use of HDF5. The HDF5 Technology suite includes tools and applications for managing, manipulating, viewing, and analyzing data in the HDF5 format.
## Installation:
`rpm -ivh cray-hdf5-1.14.3.5-*-202501130351.78f50306d6a46.@ARCH@.rpm`
The "`*`" in the install command represents compiler version combinations.
To make this the default version, execute:
`/opt/cray/pe/admin-pe/set_default_files/set_default_hdf5_1.14.3.5`
Certain components, files or programs contained within this package or product are Copyright 2019-2024 Hewlett Packard Enterprise Development LP.
HPE Cray Compiling Environment (CCE) 19.0.0
HPE Cray Compiling Environment (CCE) 19.0.0
===========================================
Purpose:
--------
CCE 19.0.0 provides Fortran, C, and C++ compilers for
HPE Cray supercomputer and HPE Apollo 2000 Gen10Plus systems.
Key Changes and Support with CCE 19.0.0:
----------------------------------------
CCE 19.0.0:
-----------
- LLVM 19 base
- CCE now links against its own build of ROCm Device Libraries
for HIP and OpenMP offload code when targeting AMD GPUs, rather
than linking against ROCm Device Libraries from an external
ROCm install. This can be overridden with
the "--rocm-device-lib-path" flag.
- Native CUDA or HIP device functions can be called from OpenMP
offload regions. This requires explicitly passing the CUDA or HIP
device object files to the OpenMP device linker using the device
linker pass-through compiler flags, "-Wc" for Fortran and
"-Xoffload-linker" for C/C++.
- CCE Fortran will only pattern match to Cray Libsci calls if a
cray-libsci module is loaded or the CCE Fortran driver auto detects
a compatible Cray Libsci installation.
- Added the following OpenACC features:
- Update directive processed in order they appear
- Enforce restrictions on variables allowed in the deviceptr clause
- Support two reference counters
- Support radeon device type
- Support init, shutdown, and set directives
- Support acc_get_default_async and acc_set_default_async routines
- Support auto loop clause
- Migrate Fortran openacc_lib module into libmodules
- Added the following OpenMP 5.1/5.2 features
- Dispatch support
- Support 'omp_set_num_teams', 'omp_get_max_teams', 'omp_set_teams_thread_limit', 'omp_get_teams_thread_limit' routines
- Support 'indirect' clause on declare target directive
- Change behavior of order(concurrent) related to reproducibility
- 'destroy' clause on depobj construct now accepts an argument
- Support 'omp_aligned_alloc', 'omp_calloc', 'omp_aligned_calloc', 'omp_realloc' MM routines
- Support 'omp_all_memory' keyword in 'depend' clause
- Support 'OMP_NUM_TEAMS' and 'OMP_TEAMS_THREAD_LIMIT' variables
- Support 'target_device' selector set
- Support iterators in 'map' clause and motion clauses
- Handle DV-based objects in has_device_addr/use_device_addr clauses
- Allow indirect calls to device procedures
- Support OpenMP indirect clause for derived type without explicit mapper
- Support 'assumes', 'begin assumes', and 'assume' directives
- Support 'target_device' selector set
- Support 'unconstrained' and 'reproducible' modifiers in 'order' clause
- Support 'omp_all_memory' keyword in 'depend' clause
- Support 'dispatch' construct and 'adjust_args', 'append_args' clauses for 'declare variant'
- Support 'begin declare variant' directive
- Support indirect function calls in mapped structs
- Distinguish "pointee" vs "pointer" for DV-based list items
- Support iterators in motion clauses
- Automatically translate/attach C++ vtable pointers when mapping C++ objects
- Explicit indirect function pointer mapping
- Support virtual function calls for mapped class objects on device
- Support 'indirect' clause on declare target directive
- Register C++ vtable with OpenMP runtime to support virtual calls on GPU
- Support 'omp_all_memory' keyword in 'depend' clause
- Added the following Fortran 2023 features
- Allow an object with a coarray ultimate component to be array or allocatable
- Coarray put with notify
- RANK clause
- Use integer arrays to specify subscripts and section subscripts
- Reduction Specifier for DO CONCURRENT to Support Intrinsic Functions
- Error conditions in collectives
- Transitioned to LLVM provided PTX Generation
- GNU OpenMP Interoperability
- Optimized AMD Turin Support
- Initial support for Intel Emerald Rapids
- RHEL 9.5 x86_64 support
- RHEL 9.5 aarch64 support
- ROCm 6.3
- NVIDIA SDK 24.11
- Enhanced DWARF Support
User and Application Impact:
----------------------------
CCE 19.0.0:
-----------
Issues or Bugs Resolved:
------------------------
CCE 19.0.0:
-----------
CAST-32956 CCE 15.0.1 compiler front end failure with omp directive in _Pragma call
CAST-33717 Fortran OpenACC declare create for nested derived types broken
CAST-33778 Reading derived datatypes from namelist
CAST-35035 undefined reference to acc_present_dump()
CAST-35127 Valid coarray code rejected by crayftn
CAST-35143 crayftn Call Type-Bound Procedure on Associate Name
CAST-33194 Cray Fortran compiler mishandling !$omp declare target device_type(any)
CAST-35381 Spurious ftn-7310 warning when building with -fsanitize=address
CAST-35419 CCE/16 compiler bug when deallocation of array of derived types
CAST-35435 Fortran CCE 17.0.0 internal compiler error backtrace at omp reduction inscan offload
CAST-35535 crayftn runtime error with user defined operator on associate name
CAST-35586 Cray Fortran compiler bug on perlmutter
CAST-35601 Crayftn issue with select type construct with pointer assignment expression
CAST-35615 Crayftn issue with allocatable character in derived typed used as a mold
CAST-35757 Unexpected behavior with fortran CCE 16
CAST-36276 ftn generates poor performing code for openmp target when if clause is present
CAST-36578 CCE OpenACC doesn't respect `acc declare create` statements when an abstract interface is in the same compilation unit
CAST-36609 CCE 18 - ftn-7066 Unsupported accelerator code error: Global in accelerator routine without declare
CAST-36653 CCE 18 - A source file involving submodules and contained subroutines crashes during compile
CAST-36712 RAJA OpenMP Unit atomic test regressions with CCE-18.0.0
CAST-37574 Macro in CCE ISO_Fortran_binding.h with common name (MAXDIM) causes name collisions and compilation issues.
Product and OS Dependencies:
----------------------------
This CCE release is supported on
- HPE Cray supercomputer systems running CSM with COS 2.5.X (SLES15 SP4) or COS 23.11 (SLES15 SP5)
- HPE Cray supercomputer systems running HPCM with COS 2.5.X (SLES15 SP4) or COS 23.11 (SLES15 SP5)
- HPE Cray supercomputer systems running HPCM with RHEL 8.10
- HPE Apollo 2000 Gen10Plus systems running RHEL 8.9
- AMD GPU offloading support requires at least ROCm 6.0 and is tested up to ROCm 6.3
Notes and Limitations:
----------------------
Upcoming change in the 20.0.0 release : Due to necessary changes to the Fortran compiler,
the 20.0.0 Fortran release will not support any modules built with previous versions of the compiler.
Any Fortran codes containing modules, submodules or the use statement will need to be compiled with
a 20.0.0 compiler. Best practice will be to build everything Fortran with a 20.0.0 compiler.
Documentation:
--------------
- S-5212 Cray Compiling Environment Release Overview (19.0)
- S-3901 Cray Fortran Reference Manual
- S-2179 Cray C and C++ Quick Reference
- Basic man pages: crayftn(1), craycc(1), crayCC(1), intro_openmp(7), intro_openacc(7)
- Please see https://clang.llvm.org/docs/UsersManual.html or use the -help command line option for
more information on using Clang
Modulefile:
-----------
The following will load the modules necessary to use CCE:
module load PrgEnv-cray
The following will switch to x.y.z version of CCE:
module swap cce cce/x.y.z
Installation instructions:
--------------------------
rpm -ivh cce-19.0.0-202502072250.cc4d36e4ff337-0.el9.x86_64.rpm.x86_64.rpm
The following script will set CCE version 19.0.0 default:
/opt/cray/pe/admin-pe/set_default_files/set_default_cce_19.0.0
License:
--------
Except for the third party components and software licensed by HPE through
proprietary agreements, components, files or programs contained within this
package or product are Copyright -2025 Hewlett Packard Enterprise Development LP.
Attribution notices for open source licensed software for this
package are detailed in the file:
/opt/cray/pe/cce/19.0.0/ATTRIBUTIONS_19.0.txt
HPE Cray MPI 8.1.32
Cray MPICH 8.1.32:
=======================================
Release Date:
-------------
February 7, 2025
Purpose:
--------
Cray MPICH 8.1.32 is based upon ANL MPICH 3.4a2 with support for libfabric
and is optimized for the Cray Programming Environment. Cray MPICH 8.1.32
is built to work with libfabric ABI version 1.6 or later (libfabric API version
1.14 or later).
Major Differences Cray MPICH 8.1.32 from the XC Cray MPICH include:
- Uses the new ANL MPICH CH4 code path and libfabric for network
support.
- Does not support -default64 mode for Fortran
- Does not support C++ language bindings
New Cray MPICH features for HPE Cray EX and Apollo systems:
- Starting from the 8.1.26 release, Cray MPICH supports the Intel Sapphire Rapids CPU HBM
processor architecture.
- On systems with AMD GPUs, Cray MPICH 8.1.26 supports all ROCm
versions starting from ROCm 5.0, including the latest ROCm 5.5.0
release.
The Cray MPICH 8.1.25 release and prior versions of
Cray MPICH are only compatible with ROCm versions up to (and
including) the ROCm 5.4.0 release.
- On Slinghot-11 systems, Cray MPICH uses the libfabric "cxi" provider
by default. On Slingshot-10 and Apollo systems, Cray MPICH uses the
libfabric "verbs;ofi_rxm" provider by default.
- Cray MPICH offers support for multiple NICs per node. Starting with
version 8.0.8, by default Cray MPICH will use all available NICs on
a node. Several rank-to-NIC assignment policies are supported. For
details on choosing a policy for assigning ranks to NICS, or for
selecting a subset of available NICs, please see the following
environment variables documented in the mpi man page.
MPICH_OFI_NIC_VERBOSE
MPICH_OFI_NIC_POLICY
MPICH_OFI_NIC_MAPPING
MPICH_OFI_NUM_NICS
- Enhancements to the MPICH_OFI_NIC_POLICY NUMA mode have been added.
Starting with version 8.0.14, if the user selects the NUMA policy,
the NIC closest to the rank is selected. A NIC no longer needs to
reside in the same numa node as the rank. If multiple NICs are
assigned to the same numa node, the local ranks will round-robin
between them. Numa distances are analyzed to select the closest NIC.
- On Slingshot-10 and Apollo systems, Cray MPICH supports runtime switching
to the UCX netmod starting with version 8.0.14. To do this load the
craype-network-ucx module and module swap between Cray-MPICH and
Cray-MPICH-UCX modules. For more information including relevant
environment variables reference the intro_mpi man page with the
Cray-MPICH-UCX module loaded.
- Lmod support for HPE Cray EX starting with Cray MPICH 8.0.16.
Key Changes and Bugs Closed:
----------------------------
Changes in Cray MPICH 8.1.32
Features and Bug Fixes:
- CAST-36188 - Fix MPI_Comm duplication of distributed graph info
- CAST-37228/CPE-7669 - Linking improvement for mpicc compiler wrappers
- CPE-870 - Update MR mode bits to align with FI_MR_ALLOCATED libfabric change
- CPE-6657 - Improve CQ error handling for HW collectives
- CPE-7340 - Add documentation for Slingshot Traffic Classes
- CPE-7712 - Document MPICH_GPU_REDUCE_KERNEL_THRESHOLD environment variable
Product and OS Dependencies:
----------------------------
The Cray MPICH 8.1.32 release is supported on the following HPE systems:
* HPE Cray EX systems with CLE
* HPE Apollo systems as part of the Cray Programming Environment
Product and OS Dependencies by network type:
--------------------------------------------------+
| Shasta |
----------------------------+---------------------+
craype | >= 2.7.6 |
----------------------------+---------------------+
cray-pals | >= 1.0.6 |
----------------------------+---------------------+
cray-pmi | >= 6.0.1 |
----------------------------+---------------------+
libfabric | >= 1.14.0 |
----------------------------+---------------------+
One or more compilers:
* AMD ROCM 6.0 or later
* AOCC 4.1 or later
* CCE 18.0 or later
* GNU 11.2 or later
* Intel 2022.1 or later
* Nvidia 23.3 or later
Notes and Limitations:
----------------------
Limitations in Cray MPICH 8.1.32:
- Cray MPICH 8.1.32 can support only ~2040 simultaneous MPI
communicators. This limit is less the XC Cray MPICH limit of
~4090 simultaneous communicators. Cray intends to raise the
limit in a future release of Cray MPICH for Shasta to at least
the XC limit.
Documentation:
--------------
For more information see the intro_mpi man page.
Modulefile:
-----------
module load cray-mpich/8.1.32
License:
--------
Except for the third party components and software licensed by HPE
through proprietary agreements, components, files or programs contained
within this package or product are Copyright -2021 Hewlett Packard
Enterprise Development LP.
Attribution notices for open source licensed software for this
package are detailed in the file:
/opt/cray/pe/mpich/8.1.32/ATTRIBUTIONS
Copyright -2025 Hewlett Packard Enterprise Development LP
HPE Cray MPI 9.0.0
HPE Cray MPI 9.0.0:
=======================================
Release Date:
-------------
February 7, 2025
Purpose:
--------
HPE Cray MPI 9.0.0 is a technology preview version of HPE Cray MPI
that supports the MPI 4.0 standard. This technology preview is intended
to allow users to test MPI 4.0 standard features. Cray MPICH 9.0.0
is based upon ANL MPICH 4.1.2 with support for libfabric and is optimized
for the Cray Programming Environment. Cray MPICH 9.0.0 is built to
work with libfabric ABI version 1.6 or later (libfabric API version 1.14
or later).
THIS PRE-RELEASE SOFTWARE IS A FUNCTIONAL-ONLY PRE-RELEASE. IT MAY NOT BE
PERFORMANT. THIS RELEASE IS AN ALPHA-QUALITY PRE-RELEASE. SOME FEATURES
MAY NOT BE SUPPORTED AT THIS TIME. THERE ARE KNOWN BUGS. IT SHOULD NOT BE
USED FOR BENCHMARKS, ACCEPTANCE TESTS, ETC. OR ANY OTHER PERFORMANCE
MEASUREMENT.
The intention is to eventually replace the current HPE Cray MPI 8.x
series of releases with the HPE Cray MPI 9.x series when 9.x is performant
and otherwise ready for customer production use.
Major Differences HPE Cray MPI 8.x and HPE Cray MPI 9.x:
- HPE Cray MPI 9.x supports the MPI 4.0 standard. The current 8.x
series supports the MPI 3.1 standard.
- HPE Cray MPI 9.x pre-releases may not be performant at this time.
- HPE Cray MPI 9.x is based on ANL MPICH 4.1.2. The current 8.x series
is based on ANL MPICH 3.4a2.
Currently Unsupported HPE Cray MPI 8.x Features in HPE Cray MPI 9.0.0:
The following features in current HPE Cray MPI (8.x) are not supported
in the 9.x pre-releases at this time:
- GPU Async Communication - Stream Triggered and Kernel Triggered
communication
- Intel GPU support
- Reduction bit-wise reproducibility (MPICH_NO_SMP environment
variable support)
- Barrier before collective (MPICH_COLL_SYNC environment variable
support)
Known bugs in HPE Cray MPI 9.0.0:
- Sessions support (MPI 4.0 feature) is not working (CPE-7491)
- We are experiencing some failures with various MPI_*probe()
calls (CPE-7488)
- SS-10/Apollo UCX support has bugs (CPE-8197,CPE-8198)
Known limitations in HPE Cray MPI 9.0.0 vs HPE Cray MPI 8.x:
- May not be performant
This is a functional pre-release. We are working on performance
tuning with the eventual intention of at least matching the
performance of HPE Cray MPI 8.x.
- Functional support of SS-10 and Apollo systems is not fully tested.
- Functional support of aarch64 systems is not fully tested.
- Only a small amount of application and large scale testing has
been done.
New HPE CRAY MPI features for HPE Cray EX and Apollo systems:
The 9.x series is based on the 8.x series and thus inherits all
of 8.x's features, improvements, etc.
- Starting from the 8.1.26 release, HPE Cray MPI supports the Intel
Sapphire Rapids CPU HBM processor architecture.
- On systems with AMD GPUs, HPE Cray MPI 8.1.26 supports all ROCm
versions starting from ROCm 5.0, including the latest ROCm 5.5.0
release.
The HPE Cray MPI 8.1.25 release and prior versions of
HPE Cray MPI are only compatible with ROCm versions up to (and
including) the ROCm 5.4.0 release.
- On Slinghot-11 systems, HPE Cray MPI uses the libfabric "cxi" provider
by default. On Slingshot-10 and Apollo systems, HPE Cray MPI uses the
libfabric "verbs;ofi_rxm" provider by default.
- HPE Cray MPI offers support for multiple NICs per node. Starting with
version 8.0.8, by default HPE Cray MPI will use all available NICs on
a node. Several rank-to-NIC assignment policies are supported. For
details on choosing a policy for assigning ranks to NICS, or for
selecting a subset of available NICs, please see the following
environment variables documented in the mpi man page.
MPICH_OFI_NIC_VERBOSE
MPICH_OFI_NIC_POLICY
MPICH_OFI_NIC_MAPPING
MPICH_OFI_NUM_NICS
- Enhancements to the MPICH_OFI_NIC_POLICY NUMA mode have been added.
Starting with version 8.0.14, if the user selects the NUMA policy,
the NIC closest to the rank is selected. A NIC no longer needs to
reside in the same numa node as the rank. If multiple NICs are
assigned to the same numa node, the local ranks will round-robin
between them. Numa distances are analyzed to select the closest NIC.
- On Slingshot-10 and Apollo systems, HPE Cray MPI supports runtime
switching to the UCX netmod starting with version 8.0.14. To do this
load the craype-network-ucx module and module swap between cray-mpich
and cray-mpich-ucx modules. For more information including relevant
environment variables reference the intro_mpi man page with the
cray-mpich-ucx module loaded.
- Lmod support for HPE Cray EX starting with HPE Cray MPI 8.0.16.
Key Changes and Bugs Closed:
----------------------------
Changes in HPE Cray MPI 9.0.0
Features and Bug Fixes:
- Support for MPI 4.0 standard
Product and OS Dependencies:
----------------------------
The HPE Cray MPI 9.0.0 release is supported on the following HPE systems:
* HPE Cray EX systems with CLE
* HPE Apollo systems as part of the Cray Programming Environment
Product and OS Dependencies by network type:
--------------------------------------------------+
| Shasta |
----------------------------+---------------------+
craype | >= 2.7.6 |
----------------------------+---------------------+
cray-pals | >= 1.0.6 |
----------------------------+---------------------+
cray-pmi | >= 6.0.1 |
----------------------------+---------------------+
libfabric | >= 1.9.0 |
----------------------------+---------------------+
One or more compilers:
* AMD ROCM 6.0 or later
* AOCC 4.1 or later
* CCE 18.0 or later
* GNU 11.2 or later
* Intel 2022.1 or later
* Nvidia 23.3 or later
Notes and Limitations:
----------------------
Limitations in HPE Cray MPI 9.0.0:
- HPE Cray MPI 9.0.0 does not support C++ language bindings
Note that HPE Cray MPI 8.x releases also does not support C++
language bindings. There is no plan to add C++ language bindings
at this time.
Documentation:
--------------
For more information see the intro_mpi man page.
Modulefile:
-----------
module load cray-mpich/9.0.0
License:
--------
Except for the third party components and software licensed by HPE
through proprietary agreements, components, files or programs contained
within this package or product are Copyright -2021 Hewlett Packard
Enterprise Development LP.
Attribution notices for open source licensed software for this
package are detailed in the file:
/opt/cray/pe/mpich/9.0.0/ATTRIBUTIONS
Copyright -2025 Hewlett Packard Enterprise Development LP
HPE Cray MPIxlate 1.0.7
Copyright 2022-2024 Hewlett Packard Enterprise Development LP
Product Release Information
================================================================================
Product identification:
-----------------------
HPE Cray MPIxlate: version 1.0.7 (built on 2025-02-08T01:01:19Z from 71b6fb9)
Purpose:
--------
HPE Cray MPIxlate enables applications compiled using an MPI library that
is not binary compatible with HPE Cray MPI, to be run without recompilation
on supported HPE platforms.
Warnings & Limitations:
-----------------------
- See NOTES in mpixlate(1)
Changes from previous release:
------------------------------
- New features:
* None
- Defects Fixed:
* None
Product dependencies:
---------------------
cray-mpich[-ucx] >= 8.1.32
Documentation:
--------------
mpixlate(1)
Environment Modules
-------------------
module load cray-mpixlate/1.0.7
================================================================================
modules 3.2.11.7
modules 3.2.11.7
==================
Release Date:
-------------
Dec, 2023
Purpose:
--------
- Package dependency update
Documentation:
---------------
See man-pages for module and modulefile.
NetCDF 4.9.0.17
# NetCDF 4.9.0.17
## Purpose:
This NetCDF release contains the following:
* SLES 15 SP6 (x86_64, aarch64)
* RHEL 9.4 (x86_64, aarch64)
* RHEL 9.5 (x86_64, aarch64)
* RHEL 8.10 (x86_64)
* Apollo RHEL 8.10 (x86_64)
* CCE 19.0.0
* AMD ROCm 6.3
* AOCC 5.0
* Intel OneAPI 2025.0.0
* Nvidia HPC SDK 24.11
* GCC 14
## Product and OS Dependencies:
The NetCDF 4.9.0.17 release is supported on the following systems, requiring the following software products:
* Cray HDF5 1.14.3.*
* CrayPE 2.1.2 or later
* SLES 15 SP6 (x86_64, aarch64)
* RHEL 8.10 (x86_64)
* Apollo RHEL 8.10 (x86_64)
* RHEL 9.4 (x86_64, aarch64)
* RHEL 9.5 (x86_64, aarch64)
* cray-mpich/8.1.0 or later
Supported on the following HPE systems:
* HPE Cray EX systems with CLE
* HPE Cray XD systems with CLE
One or more of the following compiler major versions:
* CCE 18.x or later (SLES, RHEL)
* GCC 12.3 or later (SLES)
* gcc-toolset-10.3/11.2/12.2 (RHEL 8.10)
* gcc-toolset-11.2/12.2/13.1 (RHEL 9.4)
* gcc-toolset-12.2/13.2/14.2 (RHEL 9.5)
* AOCC 4.2.0 or later
* AMD ROCm 6.2.1 or later (SLES and RHEL) or AMD ROCm 6.2 or later (Apollo RHEL 8.10)
* Intel 2024.2.0 or later
* Nvidia 23.11 or later (aarch64) and 23.3 or later (x86_64)
## Notes and Limitations:
For certain F77 source files, when compiling with `gcc/10+`, it may be necessary to configure/compile with:
`export FCFLAGS="-fallow-argument-mismatch"`
`export FFLAGS="-fallow-argument-mismatch"`
This will turn mismatch errors between actual and dummy argument lists to warnings. See:
https://github.com/Unidata/netcdf-fortran/issues/212
https://gcc.gnu.org/gcc-10/changes.html
Unidata now packages Netcdf-4 and legacy Netcdf-3 separately. HPE has decided not to continue supplying the legacy Netcdf-3 package. Due to CCE changes a version of netcdf built with "-sreal64" is neither needed nor provided.
NetCDF is supported on the host CPU but not on the accelerator.
## Documentation:
http://www.unidata.ucar.edu/software/netcdf/docs
## Modulefile:
`module load cray-netcdf`
OR
`module load cray-netcdf-hdf5parallel`
## Product Description:
NetCDF (network Common Data Form) is a set of interfaces for array-oriented data access and a freely-distributed collection of data access libraries for C, Fortran, C++, Java, and other languages. The netCDF libraries support a machine-independent format for representing scientific data. Together, the interfaces, libraries, and format support the creation, access, and sharing of scientific data.
## Installation:
`rpm -ivh cray-netcdf-4.9.0.17-*202501130641.ef4625b78e94b-64.el9.x86_64.rpm`
The "*" in the install command represents compiler version combinations.
To make this the default version, execute:
`/opt/cray/pe/admin-pe/set_default_files/set_default_netcdf_4.9.0.17`
Certain components, files or programs contained within this package or product are Copyright 2019-2024 Hewlett Packard Enterprise Development LP.
Parallel NetCDF 1.12.3.17
# Parallel NetCDF 1.12.3.17
## Purpose:
This Parallel NetCDF release contains the following:
* SLES 15 SP6 (x86_64, aarch64)
* RHEL 9.4 (x86_64, aarch64)
* RHEL 9.5 (x86_64, aarch64)
* RHEL 8.10 (x86_64)
* Apollo RHEL 8.10 (x86_64)
* CCE 19.0.0
* AMD ROCm 6.3
* AOCC 5.0
* Intel OneAPI 2025.0.0
* Nvidia HPC SDK 24.11
* GCC 14
See the Parallel NetCDF documentation for details and usage information.
## Product and OS Dependencies:
This Parallel NetCDF 1.12.3.17 release is supported on on the following systems, requiring the following software products:
* CrayPE 2.1.2 or later
* SLES 15 SP6 (x86_64, aarch64)
* RHEL 8.10 (x86_64)
* Apollo RHEL 8.10 (x86_64)
* RHEL 9.4 (x86_64, aarch64)
* RHEL 9.5 (x86_64, aarch64)
* cray-mpich/8.1.0 or later
Supported on the following HPE systems:
* HPE Cray EX systems with CLE
* HPE Cray XD systems with CLE
One or more of the following compiler major versions:
* CCE 18.x or later (SLES, RHEL)
* GCC 12.3 or later (SLES)
* gcc-toolset-10.3/11.2/12.2 (RHEL 8.10)
* gcc-toolset-11.2/12.2/13.1 (RHEL 9.4)
* gcc-toolset-12.2/13.2/14.2 (RHEL 9.5)
* AOCC 4.2.0 or later
* AMD ROCm 6.2.1 or later (SLES and RHEL) or AMD ROCm 6.2 or later (Apollo RHEL 8.10)
* Intel 2024.2.0 or later
* Nvidia 23.11 or later (aarch64) and 23.3 or later (x86_64)
## Notes and Limitations:
For certain F77 source files, when compiling with `gcc/10+`, it may be necessary to configure/compile with:
`export FCFLAGS="-fallow-argument-mismatch"`
`export FFLAGS="-fallow-argument-mismatch"`
This will turn mismatch errors between actual and dummy argument lists to warnings. See:
https://github.com/Unidata/netcdf-fortran/issues/212
https://gcc.gnu.org/gcc-10/changes.html
## Documentation:
https://parallel-netcdf.github.io/wiki/Documentation.html
## Modulefile:
`module load cray-parallel-netcdf`
## Product Description:
Parallel NetCDF is a library providing high-performance I/O while maintaining file-format compatibility with Unidata's NetCDF.
## Installation:
`rpm -ivh cray-parallel-netcdf-1.12.3.17-*202501130348.49ba8b98794d7.@ARCH@.rpm`
The "`*`" in the install command represents compiler version combinations.
To make this the default version, execute:
`/opt/cray/pe/admin-pe/set_default_files/set_default_parallel-netcdf_1.12.3.17`
Certain components, files or programs contained within this package or product are Copyright 2019-2024 Hewlett Packard Enterprise Development LP.
Perftools 25.03.0
Perftools 25.03.0
===============
Release Date: March, 2025
Purpose:
========
This is a feature and bugfix release for the following systems:
- HPE Cray EX and HPE Cray Supercomputer Systems with HPCM
- HPE Cray EX and HPE Cray Supercomputer Systems with CSM
- HPE Apollo 2000 Gen 10 Plus Systems (x86)
Key enhancements or changes from the previous release:
======================================================
o Add support for ROCm 6.3.0
o Add support for CUDA 12.5
o Upgrade to PAPI 7.2.0.1
o Upgrade to DWARF 0.11.1
o OTF2 export is now readable by Vampir
o Support shmem communication report
o Numerous Apprentice 3 features and fixed listed separately
Bugs Fixed:
===========
o CPE-1374 Improve visibility of acc regions in profiles
o CPE-4828 Clarify description of pat_report table options.
o CPE-5962 Fix misleading messages when OpenMP is present
o CPE-3555 Allow longer function names to be traced
o CPE-1893 Capture and record the value of CRAYPAT_ROOT at runtime
o CPE-6147 Assorted cupti bugfixes
o CPE-5737 Do not allowing tracing of xpmem_make
o Update wrappers to support cuda v12.6.2
o Fix Clock properties in exported otf2 archive.
o Allow runtime decision to dump performance counter group names
o CPE-6627 Add new Cassini NIC trace group for Message Matching
Apprentice3 changes:
====================
o Panels adapted from Apprentice 2
- Activity Graph
- Profile
- Counters
- I/O Rates
o Re-release of windows desktop client
- Fixed problems opening experiments
o Add support for custom pat_report options for table reports
o Additional tooltips and hints
o Default to open in the directory of last opened experiment
o Add hide/show icon to password entry box
o Additional tooltips and hints.
o Set up help view on Mac
o Fix callgraph drawing problems.
o Fix recentering logic when clicking on the timeline
Notes:
======
o This release of Perftools only supports ROCm 5.5.1
o This release of Perftools only supports CUDA 12.0 and later
Known Issues:
=============
Deprecations and Removals:
==========================
o Remove support for Reveal
o Apprentice2 is being supplanted by Appentice3 and will be removed in subsequent release
Dependencies:
=============
o A PDF reader (such as evince, acroread or okular) is required to use the
app2 online help.
o For a list of software used when validating this version of
Perftools on Cray and HPE systems, see the HPE Cray Programming Environment
release announcements.
Installation instructions:
==========================
For Apollo 80 systems, please see the HPE Cray Programming Environments
Installation Guide: Apollo 80 (ARM) System (S-8013).
For Apollo 2000 systems, please see the HPE Cray Programming Environments
Installation Guide: Apollo 2000 Gen10 Plus (x86) System (S-8012).
For HPE Cray EX (Shasta Architecture) systems, refer to the Cray Asynchronous
Installer Guide (S-8003).
Installation of app2 remote client (+ server) on Mac systems:
-------------------------------------------------------------
Apprentice2Installer-25.03.0.dmg
RevealInstaller-25.03.0.dmg
The Cray Apprentice2 and Reveal installers for Mac are included in the
perftools-clients rpm, and placed in
$CRAYPAT_ROOT/share/desktop_installers/
on a Cray Shasta User Access Node (UAN) or on a Cray login node when the
perftools software is installed.
Download the Cray Apprentice2 installer onto a desktop or laptop
running Mac OS El Capitan through Mojave. Double click on installer
to begin installation. The installer will walk you through the
process for your system.
Installation of app2 remote client (+ server) on Windows 10 systems:
--------------------------------------------------------------------
Apprentice2Installer-25.03.0.exe
The Cray Apprentice2 installer for Windows is included in the
perftools-clients rpm, and placed in
$CRAYPAT_ROOT/share/desktop_installers/
on a Cray Shasta User Access Node (UAN) or on a Cray login node when the
perftools software is installed.
Download the Cray Apprentice2 installer onto a desktop or laptop
running Windows 10. Double click on installer to begin installation.
The installer will walk you through the process for your system.
Documentation:
==============
See the following man pages:
app2, grid_order, intro_craypat, pat_build, pat_help, pat_info, pat_opts,
pat_report, pat_run, pat_view, reveal
intro_papi
perftools-base, perftools-lite, perftools-preload
accpc, cray_cassini, cray_pm, hwpc, nwpc, papi_counters, uncore
PAPIlicnotices
Search for perftools on https://support.hpe.com to access documentation
on Cray Performance Measurement and Analysis Tools
License:
========
Except for the third party modules discussed below and software licensed
by HPE through proprietary agreements, components, files or programs
contained within this package or product are Copyright 2001-2023
Hewlett Packard Enterprise Development LP.
Attribution notices for open source licensed software contained in this
package are detailed in the file:
$CRAYPAT_ROOT/ATTRIBUTIONS_perftools.txt
sanitizers4hpc 1.1.5
sanitizers4hpc 1.1.5
================================================================================
Product Description
---------------------------
- Sanitizers4hpc is a debugging tool to aid in the detection of memory leaks
and errors in parallel applications. Using LLVM's AddressSanitizer or
LeakSanitizer as a data source, Sanitizers4hpc aggregates any duplicate
messages across ranks to help provide an understandable picture of
program behavior.
Notes
---------------------------
- Shared library exposure in previous versions of sanitizers4hpc.
Previous versions of sanitizers4hpc incorrectly exported internal sanitizers4hpc
libraries into /opt/cray/pe/lib64, causing other programs that had that path in
their runpath or LD_LIBRARY_PATH to load libraries they didn't expect.
This has been fixed in the 22.08 release of sanitizers4hpc. However, links will
be present in /opt/cray/pe/lib64 pointing to older versions of sanitizers4hpc,
if an older version is installed because old installations will still modify
/opt/cray/pe/lib64 when ldconfig is run.
To clean up libraries left by previous versions of sanitizers4hpc:
Option 1:
1. Uninstall all previously installed versions of sanitizers4hpc, or remove
the .cray_dynamic_file_list file from all previously installed versions
of sanitizers4hpc, typically installed in /opt/cray/pe/sanitizers4hpc.
2. Remove any links in /opt/cray/pe/lib64 pointing into a sanitizers4hpc installation.
3. run ldconfig
Option 2:
1. Uninstall all previous versions of santizers4hpc.
Changelog
---------------------------
=======================================================================
## [1.1.5]
=======================================================================
### Bug Fixes
* CPE-6849: Suppress AMD libhsa-runtime false positives #99
* CPE-6064: Don't reset ZMQNet install directory
* PE-54417: Strip trailing BuildId if present
* PE-54265: Automatically preload libfabric if linked
* PE-53866: Improve ThreadSanitizers and Nvidia Compute Sanitizers aggregation
* PE-53603: Update ZMQNet submodule for libsodium support
* PE-51193: Activate PALS startup barrier manually through libpals
* PE-49611: Update ZMQNet
### Features
* Build with g++14 on rhel 9.5 and sles15sp6
* Add rhel 9.5, remove rhel 8.9 and sles15sp4
* CPE-6125: Support Clang MemorySanitizers
* CPE-6249: Aggregate GPU workgroup IDs
* CPE-1039: Automatically detect and add instrumented HIP runtime to LD_LIBRARY_PATH
* CPE-5880: Automatically build ASan MPI wrappers
* Support rhel 8.10
* Add builds for rhel 9.4 and sles15sp6
* Add builds for rhel 9.4 and sles15sp6
* PE-51960: Added support for rhel89/93 & gcc13
* Use gcc toolset 12 on redhat
=======================================================================
## [1.1.1]
=======================================================================
### Features
* PE-47186: Add Sanitizers4hpc User Guide
* PE-48278: Supply CUDA Sanitizer options via frontend argument
* Use native compilers on sles
* PE-48186: Support SHMEM non-shared heap checking, HTML documentation in share/doc
=======================================================================
## [1.1.0]
=======================================================================
### Bug Fixes
* PE-45171: s4hStarter was not exiting properly on ALPS
* PE-45185: Use Clang path to add LLVM utilities to PATH
* PE-45170: Fix log directory creation with CCE 15 Sanitizers
### Features
* PE-46016: Add option to filter output not matching files / functions
* Update to build with gcc-toolset-10 on redhat
* PE-45209: Update CUDA-Memcheck to Nvidia Compute Sanitizer
OS Dependencies
---------------------------
- HPE CSM systems with SLES 15 SP5 - SP6
- HPE HPCM systems with SLES 15 SP5 - SP6 or RHEL 8.10 - 9.4
- HPE Apollo systems with RHEL 8.10
Product Dependencies
---------------------------
- cray-cti >= 2.19, < 3 installed
- cdst-support >= 2.14, < 3 installed
Installation Instructions
---------------------------
- rpm -ivh sanitizers4hpc-1.1.5-20250113163306_3f1ce91531e8-88.el9.x86_64.rpm
To make sanitizers4hpc 1.1.5 the default version of sanitizers4hpc, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_sanitizers4hpc_1.1.5
Legal Notices
---------------------------
Certain components, files or programs contained within this package or product are Copyright 2022-2025 Hewlett Packard Enterprise Development LP.
Attribution notices for open source licensed software for this package are detailed in the file:
/opt/cray/pe/sanitizers4hpc/1.1.5/ATTRIBUTIONS_sanitizers4hpc.txt
Totalview 2024.4.0
totalviewsup 2024.4.0
================================================================================
Product Description
---------------------------
- Provides the HPE Totalview support package which contains modulefiles (tcl & lua),
set_default files, and content projection files for Totalview 2024.4.0.
- The only supported install directory for HPE totalviewsup is /opt/cray/pe.
- The only supported install directory for Perforce Totalview is /opt/totalview.
- Drop the license file into: /opt/totalview/2024.4.0/
Changelog
---------------------------
=======================================================================
## [2024.4.0]
=======================================================================
### Features
* Create noarch packages
=======================================================================
## [2023.4.16]
=======================================================================
### Features
* PE-49958: Implemented the auto-gen release notes/changelog tool
- Updated supported version to 2023.4.16
OS Dependencies
---------------------------
- HPE CSM systems with SLES 15 SP4
- HPE HPCM systems with SLES 15 SP5 and RHEL 8.8
- HPE Apollo systems with RHEL 8.8
Product Dependencies
---------------------------
- This totalviewsup 2024.4.0 package has a dependency on Totalview 2024.4.0.
Documentation
---------------------------
- Totalview docs can be found in /opt/toolworks/totalview.2024.4.0/doc/
- Totalview user guide:
/opt/toolworks/totalview.2024.4.0/doc/TotalView_User_Guide.pdf
- Totalview installation guide:
/opt/toolworks/totalview.2024.4.0/doc/TotalView_Installation_Guide.pdf
- The Totalview release notes:
/opt/toolworks/totalview.2024.4.0/doc/TotalView_Change_Log.pdf
- The Totalviewsup support package release notes can be found in:
/opt/cray/pe/totalviewsup/2024.4.0/release_notes.md
Installation Instructions
---------------------------
- rpm -ivh totalviewsup-2024.4.0-20250113225255_ec8b3bf2f45a-60.noarch.rpm
To make Totalview 2024.4.0 the default version, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_totalview_2024.4.0
Legal Notices
---------------------------
Copyright 2007-2025 Hewlett Packard Enterprise Development LP.
valgrind4hpc 2.13.5
valgrind4hpc 2.13.5
================================================================================
Product Description
---------------------------
- Valgrind4hpc is a Valgrind-based debugging tool to aid in the detection of memory
leaks and errors in parallel applications. Valgrind4hpc aggregates any duplicate
messages across ranks to help provide an understandable picture of
program behavior. Valgrind4hpc manages starting and redirecting output from many
copies of Valgrind, as well as deduplicating and filtering Valgrind messages.
If your program can be debugged with Valgrind, it can be debugged with Valgrind4hpc.
Changelog
---------------------------
=======================================================================
## [2.13.5]
=======================================================================
### Features
* CPE-7743: Update Valgrind to 3.24
* Build with g++14 on rhel 9.5 and sles15sp6
* Add rhel 9.5, remove rhel 8.9 and sles15sp4
* CPE-6037: Add source code to user guide
=======================================================================
## [2.13.4]
=======================================================================
### Bug Fixes
* PE-54291: Finish analysis early if job exited unexpectedly
### Features
* Support rhel 8.10
* Support rhel 8.10
* Add builds for rhel 9.4 and sles15sp6
* PE-54471: Add suppressions for aarch64 libcxi
* PE-55037: Remove deprecated exp-sgcheck tool support
=======================================================================
## [2.13.3]
=======================================================================
### Bug Fixes
* PE-51571: Parse arguments before starting network
### Features
* PE-51960: Added support for rhel89/93 & gcc13
* Update Valgrind to 3.22, support syscall userfaultfd
* Build with gcc toolset 12 on redhat
OS Dependencies
---------------------------
- HPE CSM systems with SLES 15 SP5 - SP6
- HPE HPCM systems with SLES 15 SP5 - SP6 or RHEL 8.10 - 9.4
- HPE Apollo systems with RHEL 8.10
Product Dependencies
---------------------------
- cray-mrnet >= 5.1, < 6 installed
- cray-cti >= 2.19, < 3 installed
- cdst-support >= 2.14, < 3 installed
Documentation
---------------------------
- See man valgrind4hpc.
Installation Instructions
---------------------------
- rpm -ivh valgrind4hpc-2.13.5-20250113163557_74174f2894a5-421.el9.x86_64.rpm
To make valgrind4hpc 2.13.5 the default version of valgrind4hpc, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_valgrind4hpc_2.13.5
Legal Notices
---------------------------
Certain components, files or programs contained within this package or product are Copyright 2010-2025 Hewlett Packard Enterprise Development LP.
Attribution notices for open source licensed software for this package are detailed in the file:
/opt/cray/pe/valgrind4hpc/2.13.5/ATTRIBUTIONS_valgrind4hpc.txt