-
Notifications
You must be signed in to change notification settings - Fork 144
Conference call notes 20220803
Kenneth Hoste edited this page Aug 3, 2022
·
5 revisions
(back to Conference calls)
Notes on the 203rd EasyBuild conference call, Wednesday 3 August 2022 (15:00 UTC)
Alphabetical list of attendees (11):
- Kenneth Hoste (HPC-UGent, Belgium)
- Adam Huffman (Big Data Institute, Oxford, UK)
- Terje Kvernes (University of Oslo, Norway)
- Kurt Lust (Univ. of Antwerp, Belgium + LUMI User Support Team)
- Sebastien Moretti (SIB, Switzerland)
- Alexandre Strube (Jülich Supercomputing Centre, Germany)
- Mikael Öhman (Chalmers University of Technology, Sweden)
- Bart Oldeman (Digital Research Alliance of Canada)
- Jörg Saßmannshausen (Imperial College London, UK)
- Davide Vanzo (Microsoft Azure)
- Caspar Van Leeuwen (SURFsara, Netherlands)
- overview of recent developments + outlook to next release
- Q&A
-
https://sources.easybuild.io was down for a while
- from 23 July'22 until 2 Aug'22
- fallout:
- no more automatic fallback source URL for failing downloads in EasyBuild
- framework test suite broken, since some tests rely on sources.easybuild.io to be available
- caused by migration of VM by fosshost support team (was planned since Dec'21, but kept being postponed)
- VM had to be reconfigured after migration due to change in IP, could only be done by Kenneth (who was on summer vacation)
- maybe better to move sources.easybuild.io to small VM in AWS or Azure, where it can easily be managed by other EB maintainers?
- could leverage sponsored credits for EESSI project for this?
- release timeline
- latest release: EasyBuild v4.6.0 (8 July 2022)
- ETA next release (EasyBuild v4.6.1?): end of Aug'22
- recent changes
- framework
-
easyblocks
-
bug fixes
- update PyTorch easyblock to configure without breakpad support on POWER (PR #2763)
- enhancements
- updates
-
changes
- ...
- new software
- ...
-
bug fixes
-
easyconfigs
- ~50 easyconfig PRs were merged since last conf call
- bug fixes
- enhancements
-
(noteworthy) new software
- see also overview at https://github.com/easybuilders/easybuild-easyconfigs/issues?q=is%3Amerged+label%3Anew
- ...
- noteworthy software updates
- changes
- ...
-
framework
-
reported bugs / bug fixes
-
--sanity-check-only
runs commands in installation dir (issue #4044) - handling of failing
ldd
also required insanity_check_rpath
(PR #4047)- fixed with: add
get_linked_libs_raw
function, and use it from bothcheck_linked_shared_libs
andsanity_check_rpath
(PR #4051)
- fixed with: add
-
-
enhancements
- add support for easystack file that contains easyconfig filenames + implement parsing of configuration options (PR #4021)
- add
easybuild.tools.LooseVersion
(sincedistutils
is deprecated in Python 3.10) (PR #3794)- see also issue #3963 on stop relying on distutils (will no longer be available in Python 3.12)
- adding support for the use of
--from-pr
in EasyStack files (issue #4050)
-
changes
- deprecate failure to resolve a template value (PR #3285)
- run
python
in the same process aseb
command (PR #4048) - add default moduleclass for AI/ML software? (
easybuild
issue #815)
-
reported bugs / bug fixes
-
easyblocks
- bug reports/fixes
- fix extension filter for Perl packages (PR #2699)
-
PythonPackage
is not compatible with--sanity-check-only
(issue #2745)
- enhancements
-
updates
- update OpenFOAM easyblock to support OpenFOAM 10 + clean up variant/version checks (PR #2766)
- new software
- add easyblock for CUDA compatibility libraries (PR #2764)
-
changes
- ...
- bug reports/fixes
-
easyconfigs
- close to 700 open easyconfig PRs...
- bug fixes
- fix set-alias statements for MaxQuant v2.0.3.0 (PR #15743)
- fix OpenBLAS 0.3.15 patch to correctly set the CPU core type for Tiger Lake (PR #15845)
- add CVE patch for XZ 5.2.5 + attempt to fix symbol patch for all OSs (PR #15856)
- add patch for AlphaFold v2.2.2 to fix NaN problem with jax 0.3.9 (PR #15874)
- exclude (flaky) fault_tolerance_test and fix non-x86 build for TensorFlow 2.7.1 (PR #15882)
- add patches to fix PyTorch 1.10.0 build on POWER (PR #15904)
- fix patch for PyTorch 1.9.0 on POWER (PR #15919)
- enhancements
- support offline installation of Rust (see also issue #13548)
- speed up OpenMPI 4.1.4 configure (PR #15957)
- new software
-
noteworthy software updates
- OpenFOAM v2206 (PR #15938)
- PyTorch v1.12.0 (PR #15924)
- maybe a patch could be added for https://github.com/pytorch/pytorch/pull/81691
- changes
- suggestion: always use
PythonBundle
instead ofPythonPackage
(issue #15639)
- suggestion: always use
- Jörg: LAMMPS PR is blocked by yaff still requiring HDF5 1.10, cfr. PR #15869
- worth checking whether yaff can be ported easily to HDF5 1.12 (and reaching out to the developers)?
- Mikael: use of SYSTEM in
dependencies
in PR #15900, see also issue #15901- is a change in framework needed to avoid having to implement the workaround in the easyconfigs test suite?
- Is the new Slack policy (90-day retention of messages) going to be a problem for us?
- Is academic pricing (or special pricing for FOSS) worth looking into?
- Should we consider alternatives?
- Matrix (via Element.io)?
- Mattermost (self-hosted)
- Discord
- IRC (back to the stone age)
- Terje: question regarding Mesa drivers being built
- DRI drivers are not being built? Would be useful for workstations using the Mesa installation
- Is there a reason to not build them?
- Bart: may be too close to the hardware => belongs in the OS?
- Bart: workaround could be to use OS DRI drivers via an
export
command