Skip to content

v0.1.0

Compare
Choose a tag to compare
@LeeSmet LeeSmet released this 23 Dec 15:25
· 312 commits to master since this release
v0.1.0
893b784

Features

  • Encode and save files in remote zdb backends, according to a local config
    • File compression (snappy)
    • File encryption (AES_GCM)
    • Chunking into a configurable amount of shards (including redundant shards)
    • Concept of backend groups, which group multiple backends together which are supposed to be geographically close (or otherwise more related to one another)
    • Intelligent backend selection based on required reduncency
  • Save metadata in an ETCD cluster
    • Support for authenticated access
  • Retrieve files based on the metadata
    • Can recover files as long as sufficient chunks are available
  • Repair files to (new) backends
  • Check if a file exists in the backends, by looking up file encoding metadata. If a file is found for the given path, the file hash (16 byte blake2b) is also returned

All operations take paths to files. Optionally, a virtual root can be specified, which is stripped from the path. This allows operation on location independent partial file trees