Nydus Snapshotter v0.5.0 Release

Release notes

1. Add nydus-snapshotter’s metrics collector to collect nydusd lifecycle, resource consumption metrics
2. Add nydusd runtime file system metrics about read errors and read latencies
3. Support converting nydus images and pushing them directly to AWS S3 object storage infrastructure
4. Fscache GC is performed when the snapshot is removed by requesting nydusd by the newly added HTTP API
5. Support fetch private registry auth information by setting nydus-snapshotter as a CRI proxy between kubelet and containerd
6. Fix a compatibility problem after upgrading to v0.4.0

What's Changed

• Resolve warnings in GitHub actions release workflow by @austinvazquez in #270
• feat: add some nydusd-config for metrics work by @Desiki-high in #272
• README.md: add ZRAN support description by @hsiangkao in #273
• remove scheme field in nydusd config by @imeoer in #268
• go.mod: retract v0.3.0 by @AkihiroSuda in #278
• metrics: collect the metrics about snapshotter by @sctb512 in #261
• move FOSSA license ribbon to the top position by @changweige in #281
• maintenance api server's default socket should be under root dir by @changweige in #280
• add e2e test for running nydus snapshotter in Kubernetes by @liubin in #283
• treewide: tidy up --config-path by @hsiangkao in #286
• Check KubeSecretListener start error by @liubin in #284
• converter: support ref image build by @imeoer in #245
• Support cri image service proxy mode for getting registry auth by @darfux in #282
• Collect nydusd startup cpu utilization and report its mem usage by @changweige in #279
• Don't return error if test pod is not created or has been deleted by @liubin in #289
• ignore existing symlink target existence by @changweige in #291
• backend: support s3 backend by @loheagn in #277
• test:e2e: Add cri auth test by @darfux in #290
• cleanup file system package by @changweige in #285
• Fscache gc by @kevinXYin in #262
• redirect nydusd and rafs instance configuration to new location by @changweige in #287
• converter: remove pkg/errdefs dependence by @imeoer in #293
• converter: support more options by @imeoer in #295
• snapshot:remoteMounts: Load snapshot config under shared mode by @darfux in #296
• docs: add docs for running nydus snapshotter in Kubernetes by @liubin in #297
• metrics: support HTTP metrics server by @sctb512 in #298
• config: add warmup option for nydus daemon by @sctb512 in #301
• docs: add more details about how to use kubeconfig keychain by @liubin in #300
• metrics: add nydus daemon version by @sctb512 in #302
• metrics: improve FS metrics and remove unused metrics by @sctb512 in #304

New Contributors

• @Desiki-high made their first contribution in #272
• @AkihiroSuda made their first contribution in #278
• @darfux made their first contribution in #282

Full Changelog: v0.4.0...v0.5.0

Nydus Snapshotter v0.4.1 Release

What's Changed

• Backport 0.4 by @changweige in #292

Full Changelog: v0.4.0...v0.4.1

Nydus Snapshotter v0.4.0 Release

• Enhance stability and misc bug fixes and security fixes
• Support converting OCI images to nydus images via Nerdctl
• Support Fscache driver shared domain feature
• Add an HTTP-based maintenance interface
• Export some nydusd daemons metrics
• Support configuration on P2P/Dragonfly mirror caching mode and its health check policy
• Implement Containerd snapshots Usage interface
• Shutdown the shared nydusd if it serves no snapshot when closing the nydus-snapshotter
• Refine how nydus-snapshotter removes unused snapshots and its related nydusd resources
• Nydusd failover and live-upgrade framework were added
• Redesign botldb bucket records structure

Nydus Snapshotter v0.3.3 Release

What's Changed

• remove complex blob cache GC code by @changweige in #243

Full Changelog: v0.3.2...v0.3.3

Nydus Snapshotter v0.3.2 Release

What's Changed

• retract some published module versions by @changweige in #226
• Port snapshots usage by @changweige in #227
• add mirror health checking by @sctb512 in #234

Full Changelog: v0.3.0...v0.3.2

Nydus Snapshotter v0.3.1 Release

What's Changed

• retract some published module versions by @changweige in #226

Full Changelog: v0.3.0...v0.3.1

Nydus Snapshotter v0.3.0 Release

⚠️NOTE: The tag was accidentally re-tagged, please avoid importing the nydus-snapshotter package at this tag.⚠️

What's Changed

• Remove duplicated chunk info from bootstrap v6 format by @zyfjeff in #45
• action: add sha256sum file for release assets by @imeoer in #50
• daemon: ignore checks for nydus binary when DaemonMode=none by @power-more in #57
• config: support skip_verify backend option by @imeoer in #56
• add support for erofs with fscache by @imeoer in #58
• Disable the logic for downloading bootstarp in snapshotter by @zyfjeff in #61
• fscache: enable log-level settings by @nan1994 in #64
• doc: provide container id when use ctr-remote run by @loheagn in #65
• erofs: drop "device=" options by @hsiangkao in #66
• log: fix logdir and output bug of snapshotter by @power-more in #62
• Convert: support nydus v6 fs version convert by @zyfjeff in #67
• action: relax the condition of release tag by @imeoer in #68
• args: change async-remove to sync-remove by @power-more in #69
• Implement blob layer download in snapshotter by @zyfjeff in #53
• Filesystem: fix parsing estargz TOC data by @imeoer in #70
• export label.AppendLabelsHandlerWrapper by @loheagn in #73
• config: Fix workdir json key not consist with nydusd fscache daemon by @kevinXYin in #75
• Filesystem: refactor estargz support by @imeoer in #77
• Filesytem: support estargz for rafs v6 by @imeoer in #79
• Overlayfs: add volatile option when creating Active snapshot by @power-more in #74
• fscache: fix possible conflict fscache id by @imeoer in #81
• feat: NYDUS files are convertible to OCI tar by @ccx1024cc in #80
• fscache: simple fixup for busy mountpoint by @imeoer in #83
• fscache: fix fscache workdir path for estargz by @imeoer in #82
• build(deps): bump github.com/containerd/containerd from 1.6.1 to 1.6.6 by @dependabot in #84
• resolver: replace standard http client to go-retryablehttp by @power-more in #76
• Remove incorrect or useless dependencies by @loheagn in #85
• README.md: improve the overall description by @hsiangkao in #86
• converter: enhance pack/merge/unpack options by @imeoer in #87
• feat: Only retain serious log while unpacking by @ccx1024cc in #88
• common: add flag --fs-driver to replace --daemon-backend by @changweige in #94
• Refine commandline help messages by @jiangliu in #95
• Fix a bug in annotation preparation by @jiangliu in #96
• Enable log for fscache by @jiangliu in #98
• smoke: use latest nydus release by @imeoer in #105
• Second PR to enhance the snapshotter implementation by @jiangliu in #101
• MAINTAINERS: Add Yan Song as a reviewer by @changweige in #108
• Fix some spelling mistakes, rename nydusd log file by @changweige in #99
• Optimize snapshotter to reduce container startup time by @jiangliu in #114
• Remove blob.meta files when GC nydus blob files by @jiangliu in #115
• change systemd KillMode to process by @changweige in #116
• remove nydusd daemon mode fuse when starting by @changweige in #119
• Optimize handling of stargz images by @jiangliu in #117
• Revert "remove nydusd daemon mode fuse when starting" by @hsiangkao in #122
• typical nydusd/rafs configuration file by @changweige in #121
• Refactor resolver and fix download blob bug for localfs mode by @zyfjeff in #109
• enhance how nydusd's log are logged and redirected by @changweige in #118
• tests: fix panic for unpack test by @imeoer in #123
• add k8s secret auth method by @raoxiang1996 in #113
• Fix BlobMgr Remove by @power-more in #120
• cache manager: fix cache manager failure in none daemon mode by @power-more in #124
• Add helper functions for containerd image convertion by @loheagn in #127
• converter: fix some comments by @imeoer in #130
• add a flag to control whether enable kubeconfig keychain by @changweige in #131
• github: perform test against multiple daemon mode by @changweige in #133
• rotate snapshotter log by @sctb512 in #134
• clean up and fix how nydus-snapshotter prepares mountpoints for nydusd by @changweige in #132
• use xid to generate nydusd's internal ID by @changweige in #136
• converter: improve backend implementation by @imeoer in #137
• converter: make backend package independent by @imeoer in #138
• Change upperPath permission from 0750 to 0755 by @zyfjeff in #139
• Make current machine's arch as defaulted GOARCH by @changweige in #141
• clean up nydus vestige when starting by @changweige in #148
• Add containerized e2e test by @changweige in #140
• change default work root dir to /var/lib/containerd-nydus by @changweige in #143
• converter: create work directory if not exists by @imeoer in #147
• e2e test use new default root dir by @changweige in #149
• fix: kill nydus-image process with timeout by @power-more in #146
• configure prefetch in example fscache nydusd config file by @changweige in #157
• add e2e test for fscache driver by @changweige in #153
• converter: improve performance by calculating diffid ahead of time by @imeoer in #154
• converter: improve method options by @imeoer in #155
• converter: export IsNydusBlob and MergeLayers methods by @imeoer in #159
• give NoneMode mount option with lowerdir=/dummy by @changweige in #160
• Remove default http timeout limit by @zyfjeff in #163
• clean up test purpose log directory by @changweige in #168
• Enhance daemon states management to improve usability and stability by @changweige in #152
• converter: add buffer for io.Writer by @sctb512 in #150
• replace deprecated ioutil package by @changweige in #169
• detect go race condition when perform e2e test by @changweige in #172
• [Bugfix] Modify the logic of obtaining image ref when deleting snapshots by @power-more in #170
• close file after opened and written by @changweige in ...

Nydus Snapshotter v0.3.0-rc.3 Release

What's Changed

• Change upperPath permission from 0750 to 0755 by @zyfjeff in #139
• Make current machine's arch as defaulted GOARCH by @changweige in #141
• clean up nydus vestige when starting by @changweige in #148
• Add containerized e2e test by @changweige in #140
• change default work root dir to /var/lib/containerd-nydus by @changweige in #143
• converter: create work directory if not exists by @imeoer in #147
• e2e test use new default root dir by @changweige in #149
• fix: kill nydus-image process with timeout by @power-more in #146
• configure prefetch in example fscache nydusd config file by @changweige in #157
• add e2e test for fscache driver by @changweige in #153
• converter: improve performance by calculating diffid ahead of time by @imeoer in #154
• converter: improve method options by @imeoer in #155
• converter: export IsNydusBlob and MergeLayers methods by @imeoer in #159
• give NoneMode mount option with lowerdir=/dummy by @changweige in #160

Full Changelog: v0.3.0-rc.2...v0.3.0-rc.3

Nydus Snapshotter v0.3.0-rc.2 Release

What's Changed

• converter: fix some comments by @imeoer in #130
• add a flag to control whether enable kubeconfig keychain by @changweige in #131
• github: perform test against multiple daemon mode by @changweige in #133
• rotate snapshotter log by @sctb512 in #134
• clean up and fix how nydus-snapshotter prepares mountpoints for nydusd by @changweige in #132
• use xid to generate nydusd's internal ID by @changweige in #136
• converter: improve backend implementation by @imeoer in #137
• converter: make backend package independent by @imeoer in #138

New Contributors

• @sctb512 made their first contribution in #134

Full Changelog: v0.3.0-rc.1...v0.3.0-rc.2

Nydus Snapshotter v0.3.0-rc.1 Release

What's Changed

• tests: fix panic for unpack test by @imeoer in #123
• add k8s secret auth method by @raoxiang1996 in #113
• Fix BlobMgr Remove by @power-more in #120
• cache manager: fix cache manager failure in none daemon mode by @power-more in #124
• Add helper functions for containerd image convertion by @loheagn in #127

New Contributors

• @raoxiang1996 made their first contribution in #113

Full Changelog: v0.3.0-alpha.5...v0.3.0-rc.1