Refactor Vault backend to properly handle KV v1 and KV v2

Overview

This commit is NOT backwards compatible with Vault KV v2 configurations that include /data/ in the key path.

I have broadly refactored the Vault backend to improve K/V lookup for both KV v1 and KV v2. The change enables the proper use of the prefix configuration for the KV path and accommodates the differences between the KV v1 and KV v2 endpoints, specifically the use of data in the secret path. This returns the Vault backend back to pathing parity with the other backends.

Previous
in this configuration kv-v2 is the Secrets Engine path and data was necessary for the v2 endpoint.

[template]
mode = "0644"
src = "nested.conf.tmpl"
dest = "/tmp/confd-nested-test.conf"
keys = [
  "kv-v2/data/nested",
]

Current
In this configuration the kv-v2 Secrets Engine path is prefixed and data is handled by the backend when necessary.

[template]
mode = "0644"
src = "nested.conf.tmpl"
dest = "/tmp/confd-nested-test.conf"
prefix = "/kv-v2"
keys = [
  "/nested",
]

Changes

Major Changes

• Broadly refactor Vault client (#270) @abtreece

Minor Changes

• Add proper integration check for nested config (#248) @abtreece
• Upgrade Go version from 1.20 to 1.21 (#242) @abtreece
• Pin integration test container to 22.04 for now (#241) @abtreece
• Bump github.com/hashicorp/go-retryablehttp from 0.7.1 to 0.7.7 (#258) @dependabot
• Bump github.com/aws/aws-sdk-go from 1.52.2 to 1.53.5 (#246) @dependabot
• Bump github.com/hashicorp/consul/api from 1.28.2 to 1.28.3 (#247) @dependabot
• Bump github.com/aws/aws-sdk-go from 1.51.30 to 1.52.2 (#243) @dependabot
• Bump github.com/hashicorp/vault/api from 1.12.2 to 1.13.0 (#239) @dependabot
• Bump github.com/aws/aws-sdk-go from 1.51.21 to 1.51.30 (#240) @dependabot
• Bump golang.org/x/net from 0.17.0 to 0.23.0 (#237) @dependabot
• Bump github.com/aws/aws-sdk-go from 1.51.1 to 1.51.21 (#236) @dependabot
• Bump go.etcd.io/etcd/client/v3 from 3.5.12 to 3.5.13 (#234) @dependabot
• Bump github.com/hashicorp/vault/api from 1.10.0 to 1.12.2 (#231) @dependabot
• Bump github.com/aws/aws-sdk-go from 1.49.4 to 1.51.1 (#229) @dependabot
• Bump google.golang.org/protobuf from 1.31.0 to 1.33.0 (#228) @dependabot
• Bump github.com/go-jose/go-jose/v3 from 3.0.1 to 3.0.3 (#226) @dependabot
• Bump github.com/hashicorp/consul/api from 1.27.0 to 1.28.2 (#224) @dependabot
• Bump github.com/gomodule/redigo from 1.8.9 to 1.9.2 (#223) @dependabot
• Bump go.etcd.io/etcd/client/v3 from 3.5.11 to 3.5.12 (#215) @dependabot
• Bump codecov/codecov-action from 3 to 4 (#217) @dependabot
• Bump release-drafter/release-drafter from 5 to 6 (#216) @dependabot
• Bump github.com/hashicorp/consul/api from 1.26.1 to 1.27.0 (#210) @dependabot
• Bump golang.org/x/crypto from 0.14.0 to 0.17.0 (#205) @dependabot
• Bump github.com/go-jose/go-jose/v3 from 3.0.0 to 3.0.1 (#204) @dependabot
• Bump github.com/aws/aws-sdk-go from 1.44.266 to 1.49.4 (#203) @dependabot
• Bump github.com/hashicorp/vault/api from 1.9.1 to 1.10.0 (#202) @dependabot
• Bump github/codeql-action from 2 to 3 (#201) @dependabot

Update Go to 1.20 and bump deps

Changes

• Update Go version from 1.19.5 to latest 1.20 (#200) @abtreece

Minor Changes

• Jesse bowling patch 1 (#161) @JesseBowling
• Bump github.com/hashicorp/consul/api from 1.20.0 to 1.26.1 (#199) @dependabot
• Bump go.etcd.io/etcd/client/v3 from 3.5.9 to 3.5.11 (#195) @dependabot
• Bump github.com/fsnotify/fsnotify from 1.6.0 to 1.7.0 (#198) @dependabot
• Bump github.com/sirupsen/logrus from 1.9.2 to 1.9.3 (#197) @dependabot
• Bump github.com/BurntSushi/toml from 1.2.1 to 1.3.2 (#196) @dependabot
• Bump actions/checkout from 3 to 4 (#194) @dependabot
• Bump actions/setup-go from 4 to 5 (#193) @dependabot
• Bump github.com/hashicorp/vault/api from 1.8.3 to 1.9.1 (#192) @abtreece
• Bump go.etcd.io/etcd/client/v3 from 3.5.7 to 3.5.9 (#187) @dependabot
• Bump github.com/sirupsen/logrus from 1.9.0 to 1.9.2 (#188) @dependabot
• Bump github.com/aws/aws-sdk-go from 1.44.196 to 1.44.266 (#189) @dependabot
• Bump google.golang.org/grpc from 1.49.0 to 1.56.3 (#191) @dependabot
• Bump golang.org/x/net from 0.7.0 to 0.17.0 (#190) @dependabot
• Bump actions/setup-go from 3 to 4 (#174) @dependabot
• Bump github.com/hashicorp/consul/api from 1.18.0 to 1.20.0 (#172) @dependabot
• Bump golang.org/x/net from 0.1.0 to 0.7.0 (#165) @dependabot
• Bump actions/checkout from 2 to 3 (#162) @dependabot

Update deps and fix security issues

Changes

• fix: Allow env var precedence for SSM region (#133) @abtreece
• fix: Updates golang.org/x/text to 0.3.8 (#137)

Minor Changes

• Bump github.com/aws/aws-sdk-go from 1.44.126 to 1.44.196 (#158) @dependabot
• Bump github.com/hashicorp/vault/api from 1.8.2 to 1.8.3 (#154) @dependabot
• Bump go.etcd.io/etcd/client/v3 from 3.5.5 to 3.5.7 (#153) @dependabot
• Bump github.com/hashicorp/consul/api from 1.15.3 to 1.18.0 (#144) @dependabot
• Bump github.com/BurntSushi/toml from 1.2.0 to 1.2.1 (#135) @dependabot
• Bump github.com/hashicorp/vault/api from 1.7.2 to 1.8.2 (#134) @dependabot
• Bump github.com/fsnotify/fsnotify from 1.5.4 to 1.6.0 (#127) @dependabot
• Bump go.etcd.io/etcd/client/v3 from 3.5.4 to 3.5.5 (#119) @dependabot
• Bump github.com/hashicorp/consul/api from 1.14.0 to 1.15.3 (#130) @dependabot
• Bump github.com/aws/aws-sdk-go from 1.44.95 to 1.44.126 (#132) @dependabot

Update deps and Go to 1.18

Changes

• Update Go and modules to resolve security vulns by @abtreece in #115
• Properly set errors for SSM GetParametersByPath... by @abtreece in #117

Updates

• Bump github/codeql-action from 1 to 2 by @dependabot in #80
• Bump github.com/fsnotify/fsnotify from 1.5.1 to 1.5.4 by @dependabot in #82
• Bump go.etcd.io/etcd/client/v3 from 3.5.2 to 3.5.4 by @dependabot in #83
• Bump github.com/hashicorp/vault/api from 1.5.0 to 1.7.2 by @dependabot in #92
• Bump github.com/hashicorp/consul/api from 1.12.0 to 1.13.1 by @dependabot in #97
• Bump github.com/go-zookeeper/zk from 1.0.2 to 1.0.3 by @dependabot in #100
• Bump github.com/sirupsen/logrus from 1.8.1 to 1.9.0 by @dependabot in #101
• Bump github.com/aws/aws-sdk-go from 1.43.36 to 1.44.66 by @dependabot in #103
• Bump github.com/aws/aws-sdk-go from 1.44.93 to 1.44.94 by @dependabot in #116
• Bump github.com/aws/aws-sdk-go from 1.44.94 to 1.44.95 by @dependabot in #118

Full Changelog: v0.19.0...v0.19.1

Upgrade Go to 1.17 and Refactor the project layout

Changes

• Upgrade Go to 1.17 and Refactor the project layout (abtreece)
• Enable confd to exit when no backend is set (#75) (abtreece)
• Update go-zookeeper to use active fork (#61) (abtreece)
• Switch GHA Integration tests to use containers (abtreece)

Updates

• Bump github.com/BurntSushi/toml from 1.0.0 to 1.1.0 (#74) (dependabot[bot])
• Bump github.com/aws/aws-sdk-go from 1.43.17 to 1.43.36 (#73) (dependabot[bot])
• Bump github.com/hashicorp/vault/api from 1.4.1 to 1.5.0 (#70) (dependabot[bot])
• Bump actions/setup-go from 2 to 3 (#72) (dependabot[bot])
• Bump github.com/aws/aws-sdk-go from 1.43.12 to 1.43.17 (#67) (dependabot[bot])
• Bump github.com/aws/aws-sdk-go from 1.43.7 to 1.43.12 (#65) (dependabot[bot])
• Bump actions/checkout from 2 to 3 (#64) (dependabot[bot]) -
• Update release drafter for main branch change (abtreece)
• Add dependencies to the standard labels def (abtreece)
• Bump github.com/aws/aws-sdk-go from 1.43.2 to 1.43.7 (#63) (dependabot[bot])
• Update release-drafter to inlude deps as minor (abtreece)
• Bump github.com/fsnotify/fsnotify from 1.4.9 to 1.5.1 (#58) (dependabot[bot])
• Bump github.com/aws/aws-sdk-go from 1.42.51 to 1.43.2 (#59) (dependabot[bot])

Mostly module updates

Changes

• fix: Allow connections to SSL sites without certs (#38) @metowolf
• Bump actions/setup-java from 2.3.0 to 2.4.0 (#41) @dependabot
• Bump github/super-linter from 4.7.3 to 4.8.4 (#40) @dependabot
• Bump actions/setup-java from 2.4.0 to 2.5.0 (#42) @dependabot
• Bump github.com/garyburd/redigo from 1.6.2 to 1.6.3 (#44) @dependabot
• Bump go.etcd.io/etcd from 3.3.25+incompatible to 3.3.27+incompatible (#45) @dependabot
• Bump github.com/hashicorp/consul/api from 1.8.1 to 1.12.0 (#46) @dependabot
• Bump github.com/sirupsen/logrus from 1.7.1 to 1.8.1 (#47) @dependabot
• Bump github.com/BurntSushi/toml from 0.3.1 to 1.0.0 (#54) @dependabot
• Bump github.com/aws/aws-sdk-go from 1.37.12 to 1.42.51 (#55) @dependabot
• Update app versions for backend integrations (#56) @abtreece

v0.18.3: fix: Allow YAML files to have no extension (#35)

Changes

Bugfixes

• fix: Allow YAML files to have no extension (#35) @abtreece

v0.18.2

Changes

• Allow json and yaml for file backend (#25) @andrewheberle
• Add IP lookup by interface to template funcs (#33) @abtreece

Minor Changes

• Bump github/super-linter from 4.6.1 to 4.7.3 (#32) @dependabot
• Bump actions/setup-java from 2.2.0 to 2.3.0 (#29) @dependabot
• Bump github/super-linter from 4.6.0 to 4.6.1 (#28) @dependabot
• Bump actions/setup-java from 2.1.0 to 2.2.0 (#27) @dependabot
• Bump actions/setup-java from 1 to 2.1.0 (#18) @dependabot
• Bump github/super-linter from 3.15.5 to 4.6.0 (#26) @dependabot

v0.18.1

Changes

• Update to Go 1.16.4
• Stop using UPX to compress binaries

Minor Changes

• Switch to goreleaser for builds

v0.18.0

Update Go to 1.15 and module dependencies.
Also switches from Travis to GitHub Actions for CI and adds a build for arm32.

SHA-256 checksums:

fae705c317038b91f704d1a35fb2c6c7c0669cad2573b48018a29878bffcc5df  confd-0.18.0-darwin-amd64
29552bc6ca2cfe29530e693af197d5652104963b496145b2e5e30aa577bcd7a6  confd-0.18.0-linux-amd64
e1ddf022cc6b5df6ee3dabc5eab692e7abe1ef8d1aa9291dde7126a950f10943  confd-0.18.0-linux-arm32
52adf339333a10c23041395b6f2b130e2722d7a8c18ad8a16013705cf679dcd2  confd-0.18.0-linux-arm64
3572ac6484cf9a412f0bf32a6179d8b93fb1cf1bcd052a19e6fb5767bed60342  confd-0.18.0-windows-amd64.exe