Skip to content

v2.2.0

Compare
Choose a tag to compare
@PicoCreator PicoCreator released this 17 Jan 05:07
· 269 commits to main since this release

What's Changed

  • Dataset packing by @PicoCreator in #56
    • When combined with microbatches, it can drastically increase the tokens/s for a well tuned setup - this is similar to what was done for the axolot trainer.
  • V5 batching support by @PicoCreator in #46
  • Updating to latest state / saaaa / sbbbb / scccc / sdddd code impleme… by @PicoCreator in #47
  • fix: loss forward segment count moved to correct device by @m8than in #48
  • Fix config example by @m8than in #49
  • Conversational data feature by @PicoCreator in #55

Full Changelog: v2.1.0...v2.2.0