Skip to content

v4.0.9 - Bug fixes and logging improvements
Compare
Choose a tag to compare
@adam-azarchs adam-azarchs released this 05 Jul 22:42
· 123 commits to master since this release
v4.0.9
8ddb767

What's changed

User-visible changes

  • mrjob will now log a message if stage code starts a subprocess which outlives the parent process.
  • Add slurm queue check script to bazel deployment package. Previously it was inadvertently omitted.
  • Thread-control environment variables (e.g. OMP_NUM_THREADS) are now set unconditionally. Previously they would only be set in cluster mode or in local mode when the thread limit was set to less than the total number of CPUs on the machine.
  • The python adapter no longer supports python 2.
  • Partially fix a bug which could result in the pipeline hanging after an auto-restart in cluster mode with --maxjobs set to a value other than infinity. There are some cases where this can still happen, which are still under investigation.

Developer-facing changes

  • Everything in the repository should now build on windows (with potentially reduced functionality. Don't expect to be able to run pipelines).
  • Fix up some docstrings.
  • Add an integration test for cluster mode.
  • Various dependency updates.

Full Changelog: v4.0.8...v4.0.9

Assets 4
Loading