Skip to content

Releases: lawrencejones/pgsink

v0.7.0

16 Feb 18:53
6d1a752
Compare
Choose a tag to compare

image

Changelog

6d1a752 v0.7.0
3ca43ce Merge pull request #187 from lawrencejones/import-progress-bars
e5454e5 Import progress bars
1d7ebbb Fix redirect for unrecognised UI paths
1620e54 GET /api/tables gives approximate_row_count
0f219aa Auto-migrate on boot

v0.6.0

16 Feb 13:08
b35a7e7
Compare
Choose a tag to compare

Changelog

b35a7e7 Fix attach_workspace
bc2b938 v0.6.0
f7199ae Merge pull request #185 from lawrencejones/lawrence-embed-web-assets
3b7c58f Embed Javascript assets into binary
87086c9 Cache /usr/local/share/.cache/yarn/v6
6f7e2f0 Merge pull request #186 from lawrencejones/yarn-caching
37772b6 Upgrade react-scripts
da1e102 Set YARN_CACHE_FOLDER
689300e Fatal with the error on failure
24dd095 Merge pull request #184 from lawrencejones/lawrence-javascript-dev
b6c07d1 eslint-typescript
95bc2b8 CircleCI web-build
02221fb Add Javascript CircleCI tasks
6487f8f Merge pull request #181 from lawrencejones/lawrence-first-web-release
8f85223 CI check-api-gen
f2bf580 Support toggling sync via UI
306c766 API can toggle sync status
9769fa9 dbtest.WithPublication should set comment
ccc117d Fix pub.UnsafeSetTables when empty table set
2817dad Support numeric Postgres types
1a443e1 subscription.Publication.Begin
24a0623 golang:1.16rc1 in Dockerfile
19ed50e subscription.Publication.Begin
fbb0f8f reportCompletion for all RunGroup tasks
5b0e9f5 Merge pull request #183 from lawrencejones/dep-updates
497ea4b Upgrade to go 1.16
c3f22e9 go get -u deps
2527177 Merge pull request #171 from lawrencejones/dependabot/docker/ubuntu-bionic-20210118
fb4f082 Merge pull request #168 from lawrencejones/dependabot/go_modules/cloud.google.com/go/bigquery-1.15.0
e09ce1d build(deps): bump cloud.google.com/go/bigquery from 1.14.0 to 1.15.0
da31952 Merge pull request #178 from lawrencejones/dependabot/go_modules/github.com/onsi/ginkgo-1.15.0
96e6bca build(deps): bump github.com/onsi/ginkgo from 1.12.1 to 1.15.0
3558e43 Merge pull request #172 from lawrencejones/lawrence-serve
8ba7dcb web, draft UI control interface
36d0598 API serves static assets under /web
1cb2437 Set .nvmrc for web
58cace5 rm -rf clients/typescript
3a450a5 API supports subscription management
78ab9a7 Use typescript, not typescript fetch
be72a8a Change API version to 1.0.0
56e9f49 clients/typescript
b93d86e Mount API endpoints on /api
6ba3f69 List Tables published field
90fca82 api/imports List Imports
06ca0e1 Merge pull request #173 from lawrencejones/dependabot/go_modules/github.com/google/uuid-1.2.0
133a41f build(deps): bump github.com/google/uuid from 1.1.5 to 1.2.0
52df361 Use default observability application middleware
f957121 List tables API
70d5c1c api, curl health/check
ab3e7ea build(deps): bump ubuntu from bionic-20201119 to bionic-20210118
d925ca2 Merge pull request #170 from lawrencejones/dependabot/docker/golang-1.15.7
d8bbc4e build(deps): bump golang from 1.14.7 to 1.15.7
9101aa3 Merge pull request #169 from lawrencejones/dependabot/go_modules/github.com/google/uuid-1.1.5
e824d29 build(deps): bump github.com/google/uuid from 1.1.4 to 1.1.5
b154baa Merge pull request #166 from lawrencejones/lawrence-fsync-off
92ed2f7 fsync=off for development and test databases
f32f6f4 Merge pull request #163 from lawrencejones/lawrence-fix-null-assignment
8c80bd2 Decode json as strings
d09f1a4 Test all decodable types
db315f2 Fix error when decoding null types
1c8caba Remove accidental spew.Dump
b5437a4 Merge pull request #146 from lawrencejones/dependabot/go_modules/cloud.google.com/go/bigquery-1.14.0
b724d62 build(deps): bump cloud.google.com/go/bigquery from 1.8.0 to 1.14.0
5e8a1c8 Fix debug logging branch
c301f85 Merge pull request #161 from lawrencejones/lawrence-import-job-backoff
3863a8b Exponentially backoff when import jobs fail
8567bfd Upgrade go-jet
80199f8 Merge pull request #160 from lawrencejones/lawrence-context-observability
bb752f1 s/uuid_generate_v4/gen_random_v4/
f01cd95 Re-enable db tracing, limit search path, flush traces
4de5cfc Context loggers across all packages
759dee7 internal/telem.StartSpan
c5dd6af Stash logger in context, for db logs
0852d8b pkg/subscription.Manager context o11y
ecf4259 pkg/telem avoids double annotation
ad89ac8 Merge pull request #159 from lawrencejones/lawrence-simplify-logical
60d41ea Move marshalling from logical -> subscription

v0.5.0

09 Jan 19:05
017721d
Compare
Choose a tag to compare

Changelog

017721d v0.5.0

v0.4.0

09 Jan 18:49
657126c
Compare
Choose a tag to compare

Changelog

657126c Package docstrings
389b57d v0.4.0
4a1e6cb Add go.pkg badge
c6686b1 Create LICENSE

v0.3.0

09 Jan 17:21
39ee85e
Compare
Choose a tag to compare

Changelog

39ee85e v0.3.0
12e285e Merge pull request #155 from lawrencejones/lawrence-cleanup-pkg
ebbd040 pkg/dbschema -> internal/dbschema
1bd22b9 pkg/dbtest -> internal/dbtest
4c8e7e3 pkg/telem -> internal/telem
abce28a Merge pull request #154 from lawrencejones/lawrence-ci-no-postgres
a2d19e4 ci: only Postgres where necessary

v0.2.0

09 Jan 17:05
81c117c
Compare
Choose a tag to compare

Changelog

81c117c Merge pull request #153 from lawrencejones/lawrence-fix-check-generated
030b302 ci: install goimports, for make generate
77aabcf Upgrade goreleaser, and release v0.2.0
a137d83 make generate
2c2c705 Merge pull request #152 from lawrencejones/dependabot/go_modules/github.com/google/uuid-1.1.4
265e9f1 build(deps): bump github.com/google/uuid from 1.1.2 to 1.1.4
27b4854 Merge pull request #150 from lawrencejones/lawrence-decode-cleanup
1ebb261 pkg/changelog entry.TableReference
223aa40 EncodeText is only needed for import jobs
1366b44 Simplify pkg/decode, and remove double pointers
f8e5241 pkg/logical: defer unlock
9524923 pkg/logical/message.go
59be0aa Merge pull request #151 from lawrencejones/lawrence-better-migrations
b1ffae1 Remove UsageError for simplicity
dbdb47a go.mod: go1.15
2b1f050 make structure.sql
ff0a4e7 tools.go, use in CI
b58402f ci: install dependencies before tests
039a9fc pkg/migration -> internal/migration
4ebae5e Summarise packages in README
d804f88 make dropdb also drops role
a39dc5c Merge pull request #148 from lawrencejones/dependabot/go_modules/github.com/linkedin/goavro/v2-2.10.0
0f0ffd1 build(deps): bump github.com/linkedin/goavro/v2 from 2.9.8 to 2.10.0
4f63954 rm -rf pkg/util
12d59e5 Merge pull request #142 from lawrencejones/lawrence-decoder
7a79f13 Decode stream like imports
c046f41 pkg/imports uses decode.TypeMapping
86c815f Import job selection forgot to grab the schema
c004409 pkg/decode supports varchar
b14b6e8 Fix nil decoder, where it wasn't set
a286ca8 pkg/decode generate mappings
0478ab3 --decode-fallback
b69bfc3 pkg/subscription uses changelog.Table
d337aba pkg/decode uses global mappings
3bf0b01 Makefile pkg/dbschema target
b112343 pkg/changelog.Table
d3ad18c pkg/sinks/file uses new decoder
206c13a pkg/sinnks/bigquery uses decoder, passes tests
2afc043 pkg/changelog uses logical.Relation
c0ce8ca decode.NewDecoder
44b5334 Add schema column to import_jobs
c06772a pkg/types -> pkg/decode
df3e62c pkg/types.Decoder
3c44b22 Merge pull request #140 from lawrencejones/lawrence-cleanups
a25ec13 make migrate in tests
88d923a Fix context.Deadline errors when importing
c70952e Respect context in file inserter
9c173bc Fix false positive import tests
c4bec79 pkg/telem, helpers for telemetry
6c0aecb Return args with the query
eed37e6 App fixes, from prometheus to adding a db logger
6657f60 Makefile improvements, pkg/migration/run
3ca499e Merge pull request #139 from lawrencejones/lawrence-upgrade-deps
75f4f8f go mod tidy
fe7073d go get -u go.opencensus.io
1c2b8d2 go get -u cloud.google.com/go
d97b99c go get -u github.com/onsi/gomega
43eb52e go get -u github.com/jackc/pgx/v4
5828272 go get -u github.com/prometheus/client_golang
c0e6447 Upgrade system dependencies
ea0cea2 Merge pull request #128 from lawrencejones/dependabot/docker/ubuntu-bionic-20201119
9fc3a6c build(deps): bump ubuntu from bionic-20200713 to bionic-20201119
37b8523 Merge pull request #103 from lawrencejones/dependabot/go_modules/github.com/jackc/pgx/v4-4.9.0
95ee3c3 build(deps): bump github.com/jackc/pgx/v4 from 4.8.1 to 4.9.0
9047953 Merge pull request #100 from lawrencejones/dependabot/go_modules/github.com/jackc/pgconn-1.7.0
129d69c build(deps): bump github.com/jackc/pgconn from 1.6.4 to 1.7.0
b812712 Merge pull request #99 from lawrencejones/dependabot/go_modules/github.com/jackc/pgtype-1.5.0
2ce68d2 build(deps): bump github.com/jackc/pgtype from 1.4.2 to 1.5.0
04a6f8e Merge pull request #90 from lawrencejones/dependabot/go_modules/github.com/google/uuid-1.1.2
8f26bbf Bump github.com/google/uuid from 1.1.1 to 1.1.2
2a46a79 Merge pull request #74 from lawrencejones/dependabot/docker/ubuntu-bionic-20200713
2f36aa5 Merge pull request #83 from lawrencejones/dependabot/docker/golang-1.14.7
4a8c831 Merge pull request #50 from lawrencejones/dependabot/go_modules/github.com/go-jet/jet-2.3.0incompatible
08aecad Bump golang from 1.14.3 to 1.14.7
c76d658 Merge pull request #81 from lawrencejones/dependabot/go_modules/github.com/jackc/pgproto3/v2-2.0.4
8162725 Bump github.com/go-jet/jet from 2.2.0+incompatible to 2.3.0+incompatible
dfa4416 Bump github.com/jackc/pgproto3/v2 from 2.0.2 to 2.0.4
43c3fe7 Merge pull request #82 from lawrencejones/dependabot/go_modules/github.com/jackc/pgx/v4-4.8.1
ac7bd67 Merge pull request #79 from lawrencejones/dependabot/go_modules/github.com/jackc/pgconn-1.6.4
7680642 Bump github.com/jackc/pgx/v4 from 4.8.0 to 4.8.1
86aa705 Bump github.com/jackc/pgconn from 1.6.3 to 1.6.4
63274f0 Merge pull request #75 from lawrencejones/dependabot/go_modules/github.com/jackc/pgx/v4-4.8.0
ba1e7f3 Bump github.com/jackc/pgx/v4 from 4.7.2 to 4.8.0
30cd20d Bump ubuntu from bionic-20200403 to bionic-20200713
7815066 Merge pull request #73 from lawrencejones/dependabot/go_modules/github.com/jackc/pgtype-1.4.1
b7ded66 Bump github.com/jackc/pgtype from 1.4.0 to 1.4.1
8b484ec Merge pull request #70 from lawrencejones/dependabot/go_modules/github.com/jackc/pgx/v4-4.7.2
e419746 Bump github.com/jackc/pgx/v4 from 4.7.1 to 4.7.2
e74483d Merge pull request #65 from lawrencejones/dependabot/go_modules/github.com/linkedin/goavro/v2-2.9.8
2b5a1f6 Bump github.com/linkedin/goavro/v2 from 2.9.7 to 2.9.8
d72bacf Merge pull request #64 from lawrencejones/dependabot/go_modules/github.com/jackc/pgx/v4-4.7.1
4baf2aa Bump github.com/jackc/pgx/v4 from 4.6.0 to 4.7.1
66b51aa Merge pull request #61 from lawrencejones/dependabot/go_modules/github.com/jackc/pgconn-1.6.1
e6f5d1b Bump github.com/jackc/pgconn from 1.6.0 to 1.6.1
433419a Merge pull request #44 from lawrencejones/lawrence-import-workers
b5e7c49 Assign the subscription ID to import workers
3f1e423 pgsink --no-consume
0eebe3d imports: importer.Do()
05b4314 Fix goose link in README
499fa08 Merge pull request #52 from lawrencejones/dependabot/go_modules/github.com/jackc/pgconn-1.6.0
4339fb0 Bump github.com/jackc/pgconn from 1.5.0 to 1.6.0
7ae0fb3 Merge pull request #51 from lawrencejones/dependabot/go_modules/github.com/jackc/pgproto3/v2-2.0.2
c86daa2 Bump github.com/jackc/pgproto3/v2 from 2.0.1 to 2.0.2
04b26d3 vendor: pgregory.net/rapid
26ba411 imports: buildQuery as a method
01e3cd9 imports.Build
4c652b4 imports: separate import from importer in tests
572f24d imports: use raw pgx connections
7cefcd8 dbtest: fix connection management
cc94c30 imports: functional skip locked worker
8945c9c dbtest handles all database test prep
6a9c032 imports: re-add the error column
84f4e3f imports: worker options, blank work loop
67c93f6 README
2e30eb1 pg2sink -> pgsink
d06f03d README
ebd5d80 Manage start-up/shutdown of all concurrency
c7b2b50 Reintroduce importManager
5cad5aa pkg/imports/integration uses dbtest
87d931a Allow docker-compose to boot Postgres
7edd2c0 Merge pull request #36 from lawrencejones/simplify
d2254f7 CircleCI fixes
5ff631e cmd/pg2sink/cmd: better shutdown
6ff18e2 cmd: remove imports, temporarily
8bd9fb1 pkg/dbtest
eb936ff vendor: go mod tidy
9091b9d pkg/subscription: integration tests
a0e3e08 pkg/subscription: confirmed_flush_lsn
2c80836 pkg/subscription: stream.Shutdown()
f4373b4 vendor: tidy away pgx.v3, again
7d36fec pkg/subscription.FindOrCreatePublication
92d6e02 rm -rf pkg/models
74cc444 pkg/changelog/matchers
72036dc pkg/subscription uses type-safe SQL
e122236 subscription.Create tests
97d2066 subscription.Manager tests are simpler
21ff753 Rewrite imports.Manager with tests
defbd44 Truncate tables before each test
a6fb427 Expose publication and replication slot
2d10fa9 db.SQL in cmd/pg2sink
ce43c9d pkg/subscription uses db.SQL
f43cbba Drop and restructure import_jobs
2e1fda1 Components have clear logical separation
86900d7 Ensure we heartbeat replication connection
b456223 subscription.ManagerOptions.Bind()
b8686d8 Combine publication and subscription packages
0cfa6ee pkg/dbschema/information_schema
0051ceb pkg/dbschema
f614edc Ignore docs/ while in draft
cbf01d9 Merge pull request #35 from lawrencejones/dependabot/go_modules/github.com/onsi/gomega-1.10.0
2d656a3 Bump github.com/onsi/gomega from 1.9.0 to 1.10.0
24c51b6 Merge pull request #28 from lawrencejones/dependabot/go_modules/github.com/oklog/run-1.1.0
e6aaaf4 Bump github.com/oklog/run from 1.0.0 to 1.1.0
0ee4303 Remove all but the stream command
6040d62 Merge pull request #20 from lawrencejones/dependabot/go_modules/google.golang.org/api-0.22.0
250b643 Bump google.golang.org/api from 0.4.0 to 0.22.0
c8d9442 Update release configuration
94c5ec1 Update gomod
d67b272 Add call-out to v1.0.0 project
25db45b Merge pull request #15 from lawrencejones/lawrence-go-mod-checks
5cfe717 Merge pull request #17 from lawrencejones/dependabot/go_modules/github.com/go-kit/kit-0.10.0
42fd249 Bump github.com/go-kit/kit from 0.9.0 to 0.10.0
a5f7ead Merge pull request #19 from lawrencejones/dependabot/go_modules/github.com/onsi/ginkgo-1.12.0
dc74be0 Bump github.com/onsi/ginkgo from 1.11.0 to 1.12.0
af6c802 Merge pull request #18 from lawrencejones/dependabot/go_modules/github.com/prometheus/client_golang-1.6.0
eb161a5 Bump github.com/prometheus/client_golang from 1.3.0 to 1.6.0
c1e7c25 Merge pull request #16 from lawrencejones/dependabot/go_modules/github.com/onsi/gomega-1.9.0
175e722 Bump github.com/onsi/gomega from 1.8.1 to 1.9.0
2c6a4cb go mod CI checks
ef90042 Dependabot and Docker configuration
6197542 Merge pull request #14 from lawrencejones/lawrence-upgrade-pgx
a4fc5a0 Update pgx to v4
28b6b84 Grafana 7-beta
5914085 --sink=bigquery
d50d5ae Remove trailing whitespace
d8669f4 Schema.Field.Key
874ba00 Verify buffered inserters no-op on empty flushes
b1af539 SchemaHandlerCacheOnFingerprint
61f97d4 rm -rf pkg/util.Cache
9501fb3 Sink row in dashboard
9e3c8e7 Follow filename-for-type convention with sinks
36e9d24 sink.SinkBuilder.WithInstrumentation()
41ed2a2 Consistent constructor naming
1478e8f Update README
5a72a99 Merge pull request #11 from lawrencejones/schema-handler-doesnt-route
d3f82c9 SchemaHandler doesn't route
e4b11f2 Merge pull request #10 from lawrencejones/schema-handler
1064f8a Syncer -> Schema...

Read more