Skip to content

v2.1.0 - Batching support, minor logging behaviour and default changes
Compare
Choose a tag to compare
@PicoCreator PicoCreator released this 16 Nov 08:23
· 299 commits to main since this release
v2.1.0
75b3ba5
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

What's Changed

  • Added batching support with new trainer config microbatch_size - use this to trade vram for substential tokens/sec increase (50%++)
    • This brings infctx trainer speed to be much closer to the main trainer, i should have done this earlier lol
  • Change real_ctx_len to data_ctx_len in wandb logging, to better reflect the above, as it will be now be an average of the microbatch
  • Changed default behaviour of multi_column, and fix #35
  • Improved documentation for #34
  • Microbatch support #25

Full Changelog: v2.0.1...v2.1.0

Assets 2
Loading