v0.22.0
What's New
🔥 Support for PyTorch v2.3.0
Composer now supports the recently-released PyTorch version 2.3.0! Please raise any issues with us so we can address them.
Bug Fixes
- Fixing checks for device microbatch size for sequence parallelism in #3200
- Fixing token logging in #3206
- Search for run name in MLFlowLogger in #3215
- Fix FQN names with activation checkpointing in #3210
- Strict weight matching for checkpoint loading in #3219
What's Changed
- Bump transformers by @dakinggg in #3197
- Add deprecation warnings for ICL datasets/helper functions/metrics by @bmosaicml in #3125
- Bump traitlets from 5.14.2 to 5.14.3 by @dependabot in #3204
- Raise LR schedule warnings only when necessary by @snarayan21 in #3207
- Add torch 2.3 support by @mvpatel2000 in #3209
- Add torch 2.3 CI/CD by @mvpatel2000 in #3211
- Fix daily test images by @mvpatel2000 in #3212
- Try FAv2 2.5.7 from source by @mvpatel2000 in #3213
- Update tests by @mvpatel2000 in #3217
- Fix torch 2.3 GPU tests by @mvpatel2000 in #3218
- Use flash-attn 2.5.8 with no build isolation in docker images by @snarayan21 in #3224
- Add a torch.cuda.empty_cache() in utils.save_checkpoint by @bfontain in #3216
- Require 2 steps for GS object store by @mvpatel2000 in #3228
- Add
rename_metrics
to Mlflow logger by @hanlint in #3225 - Fix daily tests by @mvpatel2000 in #3229
- Change precision for daily tests by @mvpatel2000 in #3231
- Create new Mlflow run by default and introduce
run_group
by @chenmoneygithub in #3208 - Fix daily test pt 4 by @mvpatel2000 in #3233
- Deprecate and bump version to 0.22 by @mvpatel2000 in #3230
- Fix daily tests v5 by @mvpatel2000 in #3234
- Fix daily v6 by @mvpatel2000 in #3235
- fix daily tests v7 by @mvpatel2000 in #3236
- Raise the daily test timeout by @dakinggg in #3241
- Accelerate GPU tests by @mvpatel2000 in #3237
- Make sharded checkpoint loading backwards-compatible by @snarayan21 in #3240
Full Changelog: v0.21.3...v0.22.0