From d7d39b51ee581251345b53d86e7d92d4dc1a9f25 Mon Sep 17 00:00:00 2001 From: Larry Knox Date: Fri, 31 Jan 2025 10:08:33 -0600 Subject: [PATCH 1/6] Update platforms tested details --- release_docs/RELEASE.txt | 85 ++++++---------------------------------- 1 file changed, 13 insertions(+), 72 deletions(-) diff --git a/release_docs/RELEASE.txt b/release_docs/RELEASE.txt index af7612e9a34..b948b9e597a 100644 --- a/release_docs/RELEASE.txt +++ b/release_docs/RELEASE.txt @@ -198,11 +198,14 @@ Bug Fixes since HDF5-1.14.5 release Platforms Tested =================== - - HDF5 is tested with the two latest macOS versions that are available - on github runners. As new major macOS versions become available, HDF5 - will discontinue support for the older version and add the new latest - version to its list of compatible systems, along with the previous - version. + - HDF5 is tested with the latest Linux, macOS and Windows versions that are + available on GitHub runners, with Clang, GCC and Intel compilers. As new + major versions become available, HDF5 will discontinue testing the older + version and add the new latest version to its list of compatible systems, + along with the previous version. HDF5 is also tested on the HPC systems + and older versions listed below. Test results may be viewed at the + "test results" link on the top level README page. + Linux 6.8.0-1010-aws GNU gcc, gfortran, g++ #10-Ubuntu SMP 2024 x86_64 (Ubuntu 13.2.0-23ubuntu4) 13.2.0 @@ -219,29 +222,16 @@ Platforms Tested (cmake and autotools) Linux 5.14.21-cray_shasta_c cray-mpich/8.1.28 - #1 SMP x86_64 GNU/Linux cce/15.0.0 + #1 SMP x86_64 GNU/Linux cce 18.0.1 17.0.1 (frontier) gcc/13.2 (cmake) - Linux 5.14.0-427.24.1.el9_4 GNU gcc, gfortran, g++ (Red Hat 11.4.1-3) - #1 SMP x86_64 GNU/Linux clang version 17.0.6 - Rocky 9 Intel(R) oneAPI DPC++/C++ Compiler 2024.2.0 - ifx (IFX) 2024.2.0 - (cmake and autotools) - - Linux-4.18.0-553.16.1.1toss.t4 openmpi/4.1.2 + Linux-4.18.0-553.27.1.1toss.t4 openmpi/4.1.2 #1 SMP x86_64 GNU/Linux clang 14.0.6 (corona, dane) GCC 12.1.1 Intel(R) oneAPI DPC++/C++ Compiler 2023.2.1 ifx (IFX) 2023.2.1 - Linux-4.18.0-553.5.1.1toss.t4 openmpi/4.1/4.1.6 - #1 SMP x86_64 GNU/Linux clang 16.0.6 - (eclipse) GCC 12.3.0 - Intel(R) oneAPI DPC++/C++ Compiler 2024.0.2 - ifx (IFX) 2024.0.2 - (cmake) - Linux 4.14.0-115.35.1.3chaos spectrum-mpi/rolling-release #1 SMP ppc64le GNU/Linux clang 17.0.6 (vortex) GCC 12.2.1 @@ -250,60 +240,11 @@ Platforms Tested (cmake) Linux-4.14.0-115.35.1 spectrum-mpi/rolling-release - #1 SMP ppc64le GNU/Linux clang 14.0.5, 15.0.6 - (lassen) GCC 8.3.1 - XL 2021.09.22, 2022.08.05 + #1 SMP ppc64le GNU/Linux clang 17.0.6, 18.1.8 + (lassen) GCC 12.2.1 + XL 2023.06.28, 2022.08.19 (cmake) - Linux 3.10.0-1160.36.2.el7.ppc64 gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-39) - #1 SMP ppc64be GNU/Linux g++ (GCC) 4.8.5 20150623 (Red Hat 4.8.5-39) - Power8 (echidna) GNU Fortran (GCC) 4.8.5 20150623 (Red Hat 4.8.5-39) - - Linux 3.10.0-1160.80.1.el7 GNU C (gcc), Fortran (gfortran), C++ (g++) - #1 SMP x86_64 GNU/Linux compilers: - Centos7 Version 4.8.5 20150623 (Red Hat 4.8.5-4) - (jelly/kituo/moohan) Version 4.9.3, Version 7.2.0, Version 8.3.0, - Version 9.1.0, Version 10.2.0 - Intel(R) C (icc), C++ (icpc), Fortran (icc) - compilers: - Version 17.0.0.098 Build 20160721 - GNU C (gcc) and C++ (g++) 4.8.5 compilers - with NAG Fortran Compiler Release 7.1(Hanzomon) - Intel(R) C (icc) and C++ (icpc) 17.0.0.098 compilers - with NAG Fortran Compiler Release 7.1(Hanzomon) - MPICH 3.1.4 compiled with GCC 4.9.3 - MPICH 3.3 compiled with GCC 7.2.0 - OpenMPI 3.1.3 compiled with GCC 7.2.0 and 4.1.2 - compiled with GCC 9.1.0 - PGI C, Fortran, C++ for 64-bit target on - x86_64; - Versions 18.4.0 and 19.10-0 - NVIDIA nvc, nvfortran and nvc++ version 22.5-0 - (autotools and cmake) - - - Linux-3.10.0-1160.119.1.1chaos openmpi/4.1.4 - #1 SMP x86_64 GNU/Linux clang 16.0.6 - (skybridge) Intel(R) oneAPI DPC++/C++ Compiler 2023.2.0 - ifx (IFX) 2023.2.0 - (cmake) - - Linux-3.10.0-1160.90.1.1chaos openmpi/4.1 - #1 SMP x86_64 GNU/Linux clang 16.0.6 - (attaway) GCC 12.1.0 - Intel(R) oneAPI DPC++/C++ Compiler 2024.0.2 - ifx (IFX) 2024.0.2 - (cmake) - - Linux 2.6.32-573.22.1.el6 GNU C (gcc), Fortran (gfortran), C++ (g++) - #1 SMP x86_64 GNU/Linux compilers: - Centos6 Version 4.4.7 20120313 - (platypus) Version 4.9.3, 5.3.0, 6.2.0 - MPICH 3.1.4 compiled with GCC 4.9.3 - PGI C, Fortran, C++ for 64-bit target on - x86_64; - Version 19.10-0 - Windows 10 x64 Visual Studio 2019 w/ clang 12.0.0 with MSVC-like command-line (C/C++ only - cmake) Visual Studio 2019 w/ Intel (C/C++ only - cmake) From 2ca285f1b966566777d4a11945355dea9911d2f8 Mon Sep 17 00:00:00 2001 From: Larry Knox Date: Fri, 31 Jan 2025 21:07:44 -0600 Subject: [PATCH 2/6] Add HL_FORTRAN_f90_tstlite failure with cce/18.0.1 to known problems. Minor text modifications to clarify fixes. --- release_docs/RELEASE.txt | 25 ++++++++++++++++++------- 1 file changed, 18 insertions(+), 7 deletions(-) diff --git a/release_docs/RELEASE.txt b/release_docs/RELEASE.txt index 68ef3c56bb1..4e4ff085280 100644 --- a/release_docs/RELEASE.txt +++ b/release_docs/RELEASE.txt @@ -126,6 +126,9 @@ Bug Fixes since HDF5-1.14.5 release The change has been reverted for this release and will be addressed in a different manner in a future release. + If you are using 1.14.4 or 1.14.5 and are happy with how UTF-8 file names + are handled in those versions, do not update to 1.14.6. + Reverted commit: eb0351efffe987a9c1882ccc9b03b5b0aec7f2dd @@ -137,12 +140,15 @@ Bug Fixes since HDF5-1.14.5 release Configuration ------------- - When using a system installed zlib library, the shared library is expected to - be found in the system library path. + be found in the system library path with the default HDF5_MODULE_MODE_ZLIB + setting ON. Setting the HDF5_MODULE_MODE_ZLIB option to OFF, the system installed zlib, or an alternate installed zlib library, is expected to have a correct zlib-config.cmake file. + Fixes #5155 + - Use pre-installed libaec compression library The CMake logic for finding the libaec compression library has been @@ -151,20 +157,21 @@ Bug Fixes since HDF5-1.14.5 release HDF5_ALLOW_EXTERNAL_SUPPORT:STRING=NO _USE_EXTERNAL:BOOL=OFF where is one of ZLIB, ZLIBNG, SZIP, PLUGIN. - Note that HDF5_ALLOW_EXTERNAL_SUPPORT:STRING=NO disables building all plugins - and external libraries in-line with the HDF5 library. + Note that HDF5_ALLOW_EXTERNAL_SUPPORT:STRING=NO disables building all + plugins and external libraries in-line with the HDF5 library. In addition, the _ROOT environment variables must be set, where is one of ZLIB, ZLIBNG, SZIP, libaec, PLUGIN. - Note that libaec is the expected name for using the libaec library in place of original szip. + Note that libaec is the expected name for using the libaec library in + place of original szip. See INSTALL_CMake.txt for more detailed information. - Removed the module search find_package for szip library - There is not a szip module file to use, so the find_package only uses - find_package in config mode. The choice then is to either build szip, with libaec, - inline or find a system installed szip library, built with CMake. + There is not an szip module file to use, so the find_package only uses + find_package in config mode. The remaining choices are to either build szip + with libaec inline, or find a system installed szip library built with CMake. Tools @@ -274,6 +281,10 @@ Platforms Tested Known Problems ============== + - HDF5 compiled with Cray/CCE 18.0.1 fails Fortran HL test HL_FORTRAN_f90_tstlite. + + https://github.com/HDFGroup/hdf5/issues/5283 + - When building with the NAG Fortran compiler using the Autotools and libtool 2.4.2 or earlier, the -shared flag will be missing '-Wl,', which will cause compilation to fail. This is due to a bug in libtool that was fixed in 2012 From 4ab050d6f3c75089dc112b3a6176c27ec97173df Mon Sep 17 00:00:00 2001 From: Larry Knox Date: Fri, 31 Jan 2025 21:20:44 -0600 Subject: [PATCH 3/6] Remove unused NEWSLETTER files. --- release_docs/NEWSLETTER.txt | 18 ------------------ release_docs/NEWSLETTER_README.txt | 25 ------------------------- 2 files changed, 43 deletions(-) delete mode 100644 release_docs/NEWSLETTER.txt delete mode 100644 release_docs/NEWSLETTER_README.txt diff --git a/release_docs/NEWSLETTER.txt b/release_docs/NEWSLETTER.txt deleted file mode 100644 index acad5da773e..00000000000 --- a/release_docs/NEWSLETTER.txt +++ /dev/null @@ -1,18 +0,0 @@ -HDF5 version 1.14.6-1 currently under development - -Features included for the next major release: ----------------------------------------------------------------------------- - -* The release process now provides signed Windows and Mac installation binaries - in addition to the Debian and rpm installation binaries. The Mac binaries are - built as universal binaries on an ARM-based Mac. - -* Added new routines for interacting with error stacks: H5Epause_stack, - H5Eresume_stack, and H5Eis_paused. These routines can be used to indicate - that errors from a call to an HDF5 routine should not be pushed on to an error - stack. - ----------------------------------------------------------------------------- -Please see the full release notes for detailed information regarding this release, -including a detailed list of changes. - diff --git a/release_docs/NEWSLETTER_README.txt b/release_docs/NEWSLETTER_README.txt deleted file mode 100644 index f03f710d717..00000000000 --- a/release_docs/NEWSLETTER_README.txt +++ /dev/null @@ -1,25 +0,0 @@ -INTRODUCTION -============ - -This purpose of this document is to contain entries that can be used to quickly -produce a release newsletter. When something is added to the library that is -"newsletter worthy" (i.e., new feature, CVE fix, etc.) a summary note should -be added here. - -The format should look like this: - -* SUMMARY OF NEWSLETTER-WORTHY THING - - Here is where you describe the summary. Summarize the feature, fix, or - change in general language. Remember, RELEASE.txt is for communicating - technical specifics. Text entered here is more like advertising. - - (GitHub #123, #125) - -The GitHub #s could be relevant issues or PRs. They will probably not appear -in the final newsletter, but are so that the person writing the newsletter -has easy access to context if they have questions. - -Every entry in RELEASE.txt does NOT require an entry here. The newsletter is -for communicating major changes that are of interest to anyone. Minor bugfixes, -memory leak fixes, etc. do not require entries. From 32186b67adf665ad762f298fecfdc61b8c31c604 Mon Sep 17 00:00:00 2001 From: Larry Knox Date: Mon, 3 Feb 2025 09:13:50 -0600 Subject: [PATCH 4/6] Revert "Remove unused NEWSLETTER files." NEWSLETTER.txt still needed for github.com/HDFGroup/hdf5/releases. This reverts commit 4ab050d6f3c75089dc112b3a6176c27ec97173df. --- release_docs/NEWSLETTER.txt | 18 ++++++++++++++++++ release_docs/NEWSLETTER_README.txt | 25 +++++++++++++++++++++++++ 2 files changed, 43 insertions(+) create mode 100644 release_docs/NEWSLETTER.txt create mode 100644 release_docs/NEWSLETTER_README.txt diff --git a/release_docs/NEWSLETTER.txt b/release_docs/NEWSLETTER.txt new file mode 100644 index 00000000000..acad5da773e --- /dev/null +++ b/release_docs/NEWSLETTER.txt @@ -0,0 +1,18 @@ +HDF5 version 1.14.6-1 currently under development + +Features included for the next major release: +---------------------------------------------------------------------------- + +* The release process now provides signed Windows and Mac installation binaries + in addition to the Debian and rpm installation binaries. The Mac binaries are + built as universal binaries on an ARM-based Mac. + +* Added new routines for interacting with error stacks: H5Epause_stack, + H5Eresume_stack, and H5Eis_paused. These routines can be used to indicate + that errors from a call to an HDF5 routine should not be pushed on to an error + stack. + +---------------------------------------------------------------------------- +Please see the full release notes for detailed information regarding this release, +including a detailed list of changes. + diff --git a/release_docs/NEWSLETTER_README.txt b/release_docs/NEWSLETTER_README.txt new file mode 100644 index 00000000000..f03f710d717 --- /dev/null +++ b/release_docs/NEWSLETTER_README.txt @@ -0,0 +1,25 @@ +INTRODUCTION +============ + +This purpose of this document is to contain entries that can be used to quickly +produce a release newsletter. When something is added to the library that is +"newsletter worthy" (i.e., new feature, CVE fix, etc.) a summary note should +be added here. + +The format should look like this: + +* SUMMARY OF NEWSLETTER-WORTHY THING + + Here is where you describe the summary. Summarize the feature, fix, or + change in general language. Remember, RELEASE.txt is for communicating + technical specifics. Text entered here is more like advertising. + + (GitHub #123, #125) + +The GitHub #s could be relevant issues or PRs. They will probably not appear +in the final newsletter, but are so that the person writing the newsletter +has easy access to context if they have questions. + +Every entry in RELEASE.txt does NOT require an entry here. The newsletter is +for communicating major changes that are of interest to anyone. Minor bugfixes, +memory leak fixes, etc. do not require entries. From 1e2efeee2285b49274a4aa97a2156d03d2b2e284 Mon Sep 17 00:00:00 2001 From: Larry Knox Date: Mon, 3 Feb 2025 10:38:16 -0600 Subject: [PATCH 5/6] Update test in release_docs/NEWSLETTER.txt for release page description. --- release_docs/NEWSLETTER.txt | 20 ++++++++++++-------- 1 file changed, 12 insertions(+), 8 deletions(-) diff --git a/release_docs/NEWSLETTER.txt b/release_docs/NEWSLETTER.txt index acad5da773e..8b410d0f595 100644 --- a/release_docs/NEWSLETTER.txt +++ b/release_docs/NEWSLETTER.txt @@ -3,16 +3,20 @@ HDF5 version 1.14.6-1 currently under development Features included for the next major release: ---------------------------------------------------------------------------- -* The release process now provides signed Windows and Mac installation binaries - in addition to the Debian and rpm installation binaries. The Mac binaries are - built as universal binaries on an ARM-based Mac. +* Reverted a change to the library's handling of UTF-8 file names. A change was + made in the HDF5 1.14.4 release to address some issues with the library's + handling of code pages and file paths on Windows. This change introduced + other issues with handling UTF-8 file names that caused breakage for software + using the 1.14.4 and 1.14.5 releases of HDF5. -* Added new routines for interacting with error stacks: H5Epause_stack, - H5Eresume_stack, and H5Eis_paused. These routines can be used to indicate - that errors from a call to an HDF5 routine should not be pushed on to an error - stack. + The change has been reverted for this release and will be addressed + differently in a future release. + + If you use 1.14.4 or 1.14.5 and are happy with how UTF-8 file names are + handled in those versions, do not update to 1.14.6. + +* Updated CMake find_package(ZLIB) defaults to find most system zlib installs. ---------------------------------------------------------------------------- Please see the full release notes for detailed information regarding this release, including a detailed list of changes. - From 87a9197acc6868c9563629c7fbe1b3ebfce64347 Mon Sep 17 00:00:00 2001 From: Larry Knox Date: Mon, 3 Feb 2025 11:22:12 -0600 Subject: [PATCH 6/6] Corrected line in NEWSLETTER.txt for release page. Added 3 Fortran tests that would fail with cce/18.0.1 if they weren't skipped. Removed tests that are no longer failing. --- release_docs/NEWSLETTER.txt | 2 +- release_docs/RELEASE.txt | 13 ++++++------- 2 files changed, 7 insertions(+), 8 deletions(-) diff --git a/release_docs/NEWSLETTER.txt b/release_docs/NEWSLETTER.txt index 8b410d0f595..b4d1d6b8e3d 100644 --- a/release_docs/NEWSLETTER.txt +++ b/release_docs/NEWSLETTER.txt @@ -1,6 +1,6 @@ HDF5 version 1.14.6-1 currently under development -Features included for the next major release: +This is a maintenance release with a few changes and updates: ---------------------------------------------------------------------------- * Reverted a change to the library's handling of UTF-8 file names. A change was diff --git a/release_docs/RELEASE.txt b/release_docs/RELEASE.txt index 4e4ff085280..6165c1ae104 100644 --- a/release_docs/RELEASE.txt +++ b/release_docs/RELEASE.txt @@ -281,9 +281,13 @@ Platforms Tested Known Problems ============== - - HDF5 compiled with Cray/CCE 18.0.1 fails Fortran HL test HL_FORTRAN_f90_tstlite. + - HDF5 compiled with Cray/CCE 18.0.1 fails these Fortran tests: + FORTRAN_fortranlib_test_F03 + FORTRAN_testhdf5_fortran_1_8 + HL_FORTRAN_f90_tstlite + MPI_TEST_FORT_async_test - https://github.com/HDFGroup/hdf5/issues/5283 + See https://github.com/HDFGroup/hdf5/issues/5283 - When building with the NAG Fortran compiler using the Autotools and libtool 2.4.2 or earlier, the -shared flag will be missing '-Wl,', which will cause @@ -350,11 +354,6 @@ Known Problems - Several tests currently fail on certain platforms: MPI_TEST-t_bigio fails with spectrum-mpi on ppc64le platforms. - MPI_TEST-t_subfiling_vfd and MPI_TEST_EXAMPLES-ph5_subfiling fail with - cray-mpich on theta and with XL compilers on ppc64le platforms. - - MPI_TEST_testphdf5_tldsc fails with cray-mpich 7.7 on cori and theta. - - File space may not be released when overwriting or deleting certain nested variable length or reference types.