Skip to content

v2.0.1 - Breaking change, for v5.2 / V5-R4 specification support

Compare
Choose a tag to compare
@PicoCreator PicoCreator released this 15 Nov 01:54
· 308 commits to main since this release
1e287e9

WARNING: this version breaks only supports the latest v5.2 (aka v5-R4) models, and breaks all previous models. Moving forward we will only be supporting v5-R4

What's Changed

  • Fix segment_count not properly moved onto device by @TearGosling in #37
  • Full v5 r4 rewrite by @PicoCreator @harrisonvanderbyl in #44
  • Dropped the v5beta2 folder
  • bptt_truncate=true is enforced, until state gradients is supported by the cuda kernel
  • Technically the non cuda kernel works, but its so slow (~100x slower) that you really should not train without GPUs

New Contributors / Acknowledgements

Full Changelog: v1.1.1...v2.0.1