v2.2.0
What's Changed
- Dataset packing by @PicoCreator in #56
- When combined with microbatches, it can drastically increase the tokens/s for a well tuned setup - this is similar to what was done for the axolot trainer.
- V5 batching support by @PicoCreator in #46
- Updating to latest state / saaaa / sbbbb / scccc / sdddd code impleme… by @PicoCreator in #47
- fix: loss forward segment count moved to correct device by @m8than in #48
- Fix config example by @m8than in #49
- Conversational data feature by @PicoCreator in #55
Full Changelog: v2.1.0...v2.2.0