No major features in this release

Expanding out ZCH/MCH
Increased support with Torch Dynamo/Export
Distributed Benchmarking introduced under torchrec/distributed/benchmarks for inference and training
VBE optimizations
TWRW support for VBE (I think this happened in the last release, Josh can confirm)
Generalized train_pipeline for different pipeline stage overlapping
Autograd support for traceable collectives
Output dtype support for embeddings
Dynamo tracing for sharded embedding modules
Bug fixes

Provide feedback