v0.8.2

Changelog

• 9682e59 Address slice issues
• 2e764c4 Apply suggestions from code review
• 63e52d7 Buffers are 0 indexed
• 807a85a Bump github.com/ulikunitz/xz from 0.5.11 to 0.5.12
• 5893497 Bump gotest.tools/gotestsum from 1.11.0 to 1.12.0
• 1ff97fe Make sure we use the correct sized buffer
• a4d99aa Resume interrupted connections
• 9cb9eaf Update pkg/download/consistent_hashing.go

v0.8.2-beta4

Changelog

• 17a0361 Make sure we use the correct sized buffer

v0.8.2-beta3

Changelog

• edf9621 Address slice issues
• 97a8eb3 Buffers are 0 indexed
• 807a85a Bump github.com/ulikunitz/xz from 0.5.11 to 0.5.12
• fd311d7 Resume interrupted connections

v0.8.2-beta2

Changelog

• 7205752 Address slice issues
• 97a8eb3 Buffers are 0 indexed
• 807a85a Bump github.com/ulikunitz/xz from 0.5.11 to 0.5.12
• fd311d7 Resume interrupted connections

v0.8.2-beta1

Changelog

• 807a85a Bump github.com/ulikunitz/xz from 0.5.11 to 0.5.12
• e810d81 Resume interrupted connections

v0.8.1

Changelog

• 6193d8a Update tar decompress (#200)

v0.8.0

The big changes

• Reduced memory usage, we aggressively reuse buffers to minimize the problems with OOM due to buffering.
  • note that memory usage still scales with chunk size and concurrency
• Tar extraction now supports most major compression types (automatically): gzip, xz, lz4, lzw, bzip2
• It is recommended that weights are not compressed, as the penalty to decompress ca be as high as 50x slower. This is to remove a sharp edge on pget
• Security fixes (zipslip)
• Order of files downloaded is guaranteed to be in order of the manifest (interesting things, but not super relevant for most use cases)
• Golang 1.22
• pidfile now uses XDG_RUNTIME_DIR which improves usability for non-root usage.
• General tar fixes
  • Skip headers where needed instead of erroring
  • More output with --verbose logging
  • Tar's target path is now autocreated instead of needing to be pre-created
• Using null consumer (download but don't actually save the bytes to disk) can be invoked without a destination path
  • pget -o null instead of needing pget -o null
• Lots of other general cleanup internally

Changelog

• 52f0b36 Address comments
• 5f3841e Bump github.com/golangci/golangci-lint from 1.56.1 to 1.56.2
• 49a3330 Bump github.com/golangci/golangci-lint from 1.56.2 to 1.57.2
• b3feeae Bump github.com/stretchr/testify from 1.8.4 to 1.9.0
• c142e5c Bump golang.org/x/sync from 0.6.0 to 0.7.0
• cef25f9 Bump golang.org/x/tools from 0.17.0 to 0.18.0
• d706d1e Bump golang.org/x/tools from 0.18.0 to 0.19.0
• a5dbcc3 Bump golang.org/x/tools from 0.19.0 to 0.20.0
• 881b387 Bump google.golang.org/protobuf from 1.31.0 to 1.33.0
• 8d7cd21 Check Tar Extract enablement in PersistentPreRunE
• 49be4e3 Create path when using file writer
• 0a38633 Fix single arg null consumer
• 4fcac8d Fix tar-extract
• 247d885 Guarantee Order of Downloads in multifile mode
• 40e0dd7 Handle Overwriting in the Consumer
• ee32098 Implement Stream Decompression for tar
• 368e526 Improve Stream Decompression
• df2a2f6 Improve consistent-hash testing with httpmock (#157)
• afcbff4 Improve null consumer
• 87835a6 Improve pidfile location for non-root
• 9154d43 Make .gitignore better
• db7cc43 Move Enabling Overwrite to .GetConsumer()
• 8473ce8 Prevent ZipSlip
• 4916726 Rearrange concurrency control and error handling (#191)
• b6d4d5a Reuse buffers used by bufferedReader (#177)
• 14a5144 Skip global PAXHeaders
• 42ce722 Update manifest.go
• 2f5d638 Use Golang 1.22
• 58cccd0 fixed chunk size (#173)
• c72c384 implement Wait() on Strategy to fetch remaining errors (#179)
• 4ebad73 reimplement bufferedReader on top of bufio.Reader (#180)

v0.8.0-alpha2

Changelog

• d84009f Add STDOut Consumer
• 52f0b36 Address comments
• 5f3841e Bump github.com/golangci/golangci-lint from 1.56.1 to 1.56.2
• b3feeae Bump github.com/stretchr/testify from 1.8.4 to 1.9.0
• cef25f9 Bump golang.org/x/tools from 0.17.0 to 0.18.0
• d706d1e Bump golang.org/x/tools from 0.18.0 to 0.19.0
• 881b387 Bump google.golang.org/protobuf from 1.31.0 to 1.33.0
• 8d7cd21 Check Tar Extract enablement in PersistentPreRunE
• 49be4e3 Create path when using file writer
• 0a38633 Fix single arg null consumer
• 4fcac8d Fix tar-extract
• 247d885 Guarantee Order of Downloads in multifile mode
• 40e0dd7 Handle Overwriting in the Consumer
• df2a2f6 Improve consistent-hash testing with httpmock (#157)
• afcbff4 Improve null consumer
• 87835a6 Improve pidfile location for non-root
• db7cc43 Move Enabling Overwrite to .GetConsumer()
• 8473ce8 Prevent ZipSlip
• 4916726 Rearrange concurrency control and error handling (#191)
• b6d4d5a Reuse buffers used by bufferedReader (#177)
• 42ce722 Update manifest.go
• 2f5d638 Use Golang 1.22
• 58cccd0 fixed chunk size (#173)
• c72c384 implement Wait() on Strategy to fetch remaining errors (#179)
• 4ebad73 reimplement bufferedReader on top of bufio.Reader (#180)

v0.8.0-alpha1

Changelog

• af9e62f Add STDOut Consumer
• 52f0b36 Address comments
• 5f3841e Bump github.com/golangci/golangci-lint from 1.56.1 to 1.56.2
• b3feeae Bump github.com/stretchr/testify from 1.8.4 to 1.9.0
• cef25f9 Bump golang.org/x/tools from 0.17.0 to 0.18.0
• d706d1e Bump golang.org/x/tools from 0.18.0 to 0.19.0
• 881b387 Bump google.golang.org/protobuf from 1.31.0 to 1.33.0
• 8d7cd21 Check Tar Extract enablement in PersistentPreRunE
• 49be4e3 Create path when using file writer
• 0a38633 Fix single arg null consumer
• 4fcac8d Fix tar-extract
• 247d885 Guarantee Order of Downloads in multifile mode
• 40e0dd7 Handle Overwriting in the Consumer
• df2a2f6 Improve consistent-hash testing with httpmock (#157)
• afcbff4 Improve null consumer
• 87835a6 Improve pidfile location for non-root
• db7cc43 Move Enabling Overwrite to .GetConsumer()
• 8473ce8 Prevent ZipSlip
• 4916726 Rearrange concurrency control and error handling (#191)
• b6d4d5a Reuse buffers used by bufferedReader (#177)
• 42ce722 Update manifest.go
• 2f5d638 Use Golang 1.22
• 58cccd0 fixed chunk size (#173)
• c72c384 implement Wait() on Strategy to fetch remaining errors (#179)
• 4ebad73 reimplement bufferedReader on top of bufio.Reader (#180)

v0.6.2

Changelog

• 4517037 Bump github.com/golangci/golangci-lint from 1.55.2 to 1.56.1 (#153)
• 7593122 Gracefully handle missing SRV records