CHANGELOG.md

Changelog

2.14.6 (2024-10-23)

Bug Fixes

• Bring SampleRowKeys default timeout closer in line to the Veneer… (#4451) (94ab74d)

2.14.5 (2024-10-03)

Dependencies

• upgrade java-bigtable to 2.45.0 (#4447) (f83e8ef)

2.14.4 (2024-09-30)

Dependencies

• upgrade beam to 2.58.0 (#4436) (a5064db)
• upgrade java-bigtable to 2.44.1 (#4445) (ae7b9d8)

2.14.3 (2024-07-29)

Bug Fixes

• align the handling of regular expressions between hbase & bigtable (#4430) (ae0a15d)

Performance Improvements

• Set gcsUploadBufferSizeBytes to 8MB for Export Jobs to reduce RAM usage (#4366) (e59d453)

Dependencies

• upgrade beam to 2.57.0 (#4432) (f20b907)

2.14.2 (2024-05-10)

Dependencies

• upgrade to bigtable 2.39.2 (#4355) (7b8dffa)

2.14.1 (2024-04-19)

Bug Fixes

• Add paging to hbase client (#4166) (33facf5)

Dependencies

• update versions and allow disabling client side metrics (#4350) (efd75e1)

2.14.0 (2024-04-11)

Features

• add bigtable-hbase-2x-mapreduce artifact (#4343) (156c111)
• add integration test to illustrate minimum set of hbase dependencies required for bigtable-hbase-2x (#4339) (c1a1a22)
• support the bare minimum of RegionMetrics to support RegionSize… (#4342) (7be62ea)

Bug Fixes

• retry idle timeout (#4209) (4064af8)

Dependencies

• add a direct dep on google-cloud-bigtable in the -shaded artifacts to workaround UpperBound issues (#4244) (15c567a)
• clean up deps for mirroring-client (#4232) (5f98419)
• clean up deps in replication client (#4235) (a27ca11)
• clean up mirroring client deps (#4261) (ce9e53b)
• make dropwizard metrics an optional dependency (#4224) (afb1802)
• mark conscrypt as a provided dep (#4200) (62ed2d0)
• minor tweaks (#4241) (ff97ac9)
• partial upgrade to hbase 2.5 (#4328) (33c7558)
• remove overspecified slf4 versions & remove unused props (#4240) (fff9ff0)
• unflatten 2x hadoop & shaded artifact deps (#4226) (d32e540)
• unflatten build-helper module (#4229) (0a7d88a)
• unflatten dataflow artifact deps (#4228) (9ff8df2)
• unflatten deps for 1x shaded and hadoop (#4223) (df0a821)
• unflatten deps for bigtable-hbase-1.x (#4222) (194d061)
• unflatten deps for hbase 2x (#4239) (8795de8)
• unflatten the rest of the 1x artifacts (#4227) (5778ecb)
• unflatten transitive dependencies in integration-tests-common (#4208) (9321f8b)
• unflatten transitive dependencies in bigtable-hbase (#4207) (ee15b1c)
• update bigtable-metrics-api version (#4193) (000208c)
• update dependency io.dropwizard.metrics:metrics-graphite to v4.2.22 (#4230) (68024f8)
• update dependency net.bytebuddy:byte-buddy to v1.14.10 (#4250) (cff9ada)
• update to beam 2.51.0 (#4204) (c17306c)
• upgrade google-cloud-java to 2.29.1 (#4245) (9a5e116)
• use hbase 2x & hadoop3 in beam import (#4338) (52c1a4b)

2.12.0 (2023-10-18)

Features

• Use concrete classes for hbase.client.registry.impl (#4043) (#4188) (cc22f2f)

2.11.3 (2023-10-13)

Bug Fixes

• Close batcher for writeToMultipleTables (#4182) (b88107a)

Dependencies

• Update google-cloud-bigtable 2.28.0 (#4185) (09f3588)

2.11.2 (2023-09-29)

Dependencies

• Update bigtable to 2.27.3 (#4167) (1562992)

2.11.1 (2023-09-15)

Dependencies

• Update google-cloud-bigtable to 2.27.2 (#4160) (2a15804)

2.11.0 (2023-08-04)

Features

• Add a new configuration key to inject custom credentials class for authentication (#4100) (998b5e5)

Bug Fixes

• Add timeout to bulkMutation's close() (#4140) (79eb7c7)
• Bidirectional replication flakey test (#4130) (3e1de74)

2.10.1 (2023-07-18)

Dependencies

• Update bigtable dependency to fix mutation limit (#4122) (ccea847)

2.10.0 (2023-06-29)

Features

• Add experimental support for reverse scans public preview (#4060) (518a388)
• Two-way replication for Hbase-Bigtable replication (#3920) (0d75465)

2.9.0 (2023-06-06)

Features

• Enable batch write flow control (#4077) (4f7f79c)

2.8.1 (2023-05-17)

Bug Fixes

• Deserialize Source and SourceWithKeys correctly so SampleRowKeys only get called once (#4078) (de7bdac)

2.8.0 (2023-05-10)

Features

• Optimize dataflow job start by making sample row keys lighter (#4075) (f0f453d)

Bug Fixes

• Prevent connections from leaking for reads (#4073) (56d32bd)

2.7.4 (2023-04-04)

Dependencies

• Update google-cloud-bigtable dependencies (#4052) (9eafedb)

2.7.3 (2023-03-30)

Bug Fixes

• Fix CloudBigtableIO scan to take version and filters (#3901) (307874f)

Dependencies

• Update dependency com.google.protobuf:protobuf-java to v3.22.1 (#3995) (8cf46f1)
• Update dependency com.google.protobuf:protobuf-java to v3.22.2 (#4001) (66962ef)
• Update dependency net.bytebuddy:byte-buddy to v1.14.1 (#3993) (ced055e)
• Update dependency net.bytebuddy:byte-buddy to v1.14.2 (#4004) (6327eb2)
• Update dependency org.codehaus.plexus:plexus-utils to v3.5.1 (#3988) (8ee2d3c)
• Update google-cloud-bigtable dependencies to 2.20.0 (9b96f8b)

2.7.2 (2023-02-27)

Bug Fixes

• deps: Re-add reload4j as a dependency in bigtable-hbase-beam (#3985) (03de7ff)

Dependencies

• Update dependency com.google.protobuf:protobuf-java to v3.22.0 (#3964) (1b96824)
• Update dependency net.bytebuddy:byte-buddy to v1.12.23 (#3946) (3591813)
• Update dependency net.bytebuddy:byte-buddy to v1.13.0 (#3955) (e4b356a)
• Update dependency net.bytebuddy:byte-buddy to v1.14.0 (#3968) (c9217a9)
• Update dependency org.apache.logging.log4j:log4j-api to v2.20.0 (#3972) (bfc997b)
• Update dependency org.apache.logging.log4j:log4j-core to v2.20.0 (#3973) (c9f1997)
• Update dependency org.apache.logging.log4j:log4j-slf4j-impl to v2.20.0 (#3974) (e7440fa)
• Update google-cloud-bigtable dependencies (#3950) (904ba2c)
• Update google-cloud-bigtable dependencies (#3956) (8891330)
• Update google-cloud-bigtable dependencies (2.19.1) (#3963) (69fccba)
• Update google-cloud-bigtable dependencies (2.19.2) (#3976) (e4c946e)

2.7.1 (2023-01-30)

Bug Fixes

• Fix compatibility of CloudBigtableIO with the emulator env var (#3940) (76bb401)

Dependencies

• Update dependency com.fasterxml.jackson.core:jackson-databind to v2.14.2 (#3938) (714e147)

2.7.0 (2023-01-25)

Features

• Next release from main branch is 2.7.0 (#3887) (6c3485d)

Bug Fixes

• Making outer main public for export/templates (#3900) (6bff440)
• Set client config log level to INFO (#3876) (5b8ce5c)

Dependencies

• Replace all transitive log4j deps with reload4j (#3930) (29019ad)
• Update bigtable version to 2.17.1, shared config to 1.5.5 (#3889) (7729556)
• Update dependency com.google.protobuf:protobuf-java to v3.21.11 (#3881) (1ac8692)
• Update dependency com.google.protobuf:protobuf-java to v3.21.12 (#3896) (5d0f431)
• Update dependency net.bytebuddy:byte-buddy to v1.12.20 (#3898) (58a4531)
• Update dependency net.bytebuddy:byte-buddy to v1.12.21 (#3905) (6f68e94)
• Update dependency net.bytebuddy:byte-buddy to v1.12.22 (#3911) (42a87a7)
• Update dependency org.junit.platform:junit-platform-launcher to v1.9.2 (#3907) (787e83c)
• Update dependency org.junit.vintage:junit-vintage-engine to v5.9.2 (#3908) (1b19251)
• Update google-cloud-bigtable dependencies (#3934) (841bb29)

2.6.5 (2022-12-08)

Dependencies

• Update bigtable-client-core.version to v1.28.0 (#3870) (961bd52)
• Update dependency com.google.cloud.bigtable:bigtable-client-core to v1.28.0 (#3871) (3823a3e)
• Update dependency com.google.protobuf:protobuf-java to v3.21.10 (#3874) (a454aee)
• Update opencensus to 0.31.1 and use variable where needed (#3862) (bf01607)
• Upgrade beam to 2.43.0 (#3857) (fc106a7)

2.6.4 (2022-11-30)

Bug Fixes

• Allow creating a managed channel (#3824) (0e4016f)
• Fix logging with PutAdapter and SchemaTranslator (#3635) (90e51ef)

Dependencies

• Update dependency com.fasterxml.jackson.core:jackson-databind to v2.14.0 (#3842) (abf8d2a)
• Update dependency com.fasterxml.jackson.core:jackson-databind to v2.14.1 (#3864) (0dedbe2)
• Update dependency com.google.cloud:google-cloud-bigtable-emulator-core to v0.152.0 (#3834) (c13a90e)
• Update dependency com.google.cloud:google-cloud-bigtable-emulator-core to v0.152.0 (#3835) (5c43cee)
• Update dependency com.google.cloud:google-cloud-bigtable-emulator-core to v0.152.1 (#3848) (ac8088f)
• Update dependency com.google.cloud:google-cloud-bigtable-emulator-core to v0.152.1 (#3849) (dd4bfc6)
• Update dependency com.google.cloud:google-cloud-bigtable-emulator-core to v0.153.0 (#3852) (d7ee4b3)
• Update dependency com.google.cloud:google-cloud-bigtable-emulator-core to v0.153.0 (#3853) (05e31b1)
• Update dependency com.google.guava:guava (#3808) (0cc6e11)
• Update dependency com.google.protobuf:protobuf-java to v3.21.8 (#3729) (4395666)
• Update dependency com.google.protobuf:protobuf-java to v3.21.9 (#3831) (52f8e52)
• Update dependency net.bytebuddy:byte-buddy to v1.12.18 (#3815) (cbf0512)
• Update dependency net.bytebuddy:byte-buddy to v1.12.19 (#3863) (3f9f04b)
• Update dependency org.apache.commons:commons-compress to v1.22 (#3839) (3b302d4)
• Update dependency org.apache.logging.log4j:log4j-api to v2.19.0 (#3777) (aa4e44e)
• Update dependency org.apache.logging.log4j:log4j-core to v2.19.0 (#3778) (f27aa98)
• Update dependency org.apache.logging.log4j:log4j-slf4j-impl to v2.19.0 (#3779) (88c7c24)
• Update dependency org.codehaus.plexus:plexus-utils to v3.5.0 (#3829) (bb02d4a)
• Update dependency org.junit.platform:junit-platform-launcher to v1.9.1 (#3781) (2eef4b0)
• Update jackson-databind to 2.13.4.2 (#3830) (8b28c16)
• Update jmh.version to v1.36 (#3856) (ca07e36)
• Update veneer to 2.16.0 (#3855) (4d00a79)

2.6.3 (2022-10-05)

Dependencies

• Update bigtable.version to v2.14.1 (#3810) (99fb1be)
• Update dependency com.google.cloud:google-cloud-bigtable-emulator-core to v0.151.1 (#3811) (6ffc6a6)
• Update dependency com.google.cloud:google-cloud-bigtable-emulator-core to v0.151.1 (#3812) (6e4144a)

2.6.2 (2022-10-04)

Dependencies

• Update bigtable.version to v2.12.0 (#3767) (b92eb0c)
• Update bigtable.version to v2.14.0 (#3802) (756d209)
• Update dependency com.fasterxml.jackson.core:jackson-databind to v2.13.4 (#3765) (bdb21c1)
• Update dependency com.google.cloud:google-cloud-bigtable-emulator-core to v0.148.2 (#3768) (32bd491)
• Update dependency com.google.cloud:google-cloud-bigtable-emulator-core to v0.149.0 (#3774) (57b85e5)
• Update dependency com.google.cloud:google-cloud-bigtable-emulator-core to v0.149.0 (#3775) (4d1b9ce)
• Update dependency com.google.cloud:google-cloud-bigtable-emulator-core to v0.151.0 (#3803) (c308ef3)
• Update dependency com.google.cloud:google-cloud-bigtable-emulator-core to v0.151.0 (#3804) (8cbe62a)
• Update dependency net.bytebuddy:byte-buddy to v1.12.16 (#3772) (22b1aca)
• Update dependency net.bytebuddy:byte-buddy to v1.12.17 (#3782) (2836cd5)

2.6.1 (2022-08-29)

Bug Fixes

• add maven placeholder to protobuf-java-format-shaded module, match version number to mirroring client (#3741) (2e39ff5)
• prevent scanner cancellation from reading an extra row (#3759) (dc66f9d)

Dependencies

• update dependency com.google.cloud:google-cloud-bigtable-emulator-core to v0.148.1 (#3763) (543a8f4)
• update dependency net.bytebuddy:byte-buddy to v1.12.14 (#3754) (dd75b71)
• update dependency org.junit.platform:junit-platform-launcher to v1.9.0 (#3724) (0e83e32)
• upgrade bigtable.version to 2.11.1 (#3761) (f40496c)

2.6.0 (2022-08-10)

Features

• add mirroring client for migrations (#3698) (d350c36)
• mapreduce hashtable/synctable jobs (#3688) (cbcb555)

Bug Fixes

• update syntax in readme for dataflow max workers (#3675) (ded52ad)

Dependencies

• update bigtable-client-core.version to v1.27.0 (#3680) (46d6bf3)
• update bigtable-client-core.version to v1.27.1 (#3712) (793c78c)
• update dependency com.google.api:api-common to v1.10.6 (#3713) (887e112)
• update dependency com.google.cloud.bigtable:bigtable-client-core to v1.27.0 (#3681) (eae4d4b)
• update dependency com.google.cloud.bigtable:bigtable-client-core to v1.27.1 (#3715) (7c2366f)
• update dependency io.prometheus:simpleclient_httpserver to v0.16.0 (#3723) (6522923)
• update dependency net.bytebuddy:byte-buddy to v1.12.13 (#3716) (b8acf1f)
• update hbase1.version to v1.7.2 (#3736) (ad2967a)
• upgrade jackson-databind to 2.13.3 (#3734) (f66be5d)

2.5.0 (2022-07-13)

Features

• add ocagent exporter to shaded jars to allow customers more fle… (#3683) (25b2af8)
• add toString for RowKeyWrapper to ease debugging (#3648) (9007abc)

Dependencies

• update bigtable.version to v2.9.0 (#3666) (b67c790)
• update dependency net.bytebuddy:byte-buddy to v1.12.12 (#3658) (07772b1)

2.4.0 (2022-06-09)

Features

• optimize scan filters (#3651) (23af529)

Dependencies

• update bigtable.version to v2.7.0 (#3629) (90956d1)
• update bigtable.version to v2.8.0 (#3640) (93b7067)
• update dependency com.google.cloud:google-cloud-bigtable-emulator to v0.144.0 (#3630) (5cd5c59)
• update dependency com.google.cloud:google-cloud-bigtable-emulator to v0.144.0 (#3631) (3c4db31)
• update dependency org.codehaus.plexus:plexus-utils to v3.4.2 (#3624) (c555559)

2.3.0 (2022-05-18)

Features

• add enableSnappy flag to import snapshot pipeline and select th… (#3586) (8c1854d)

Dependencies

• remove client-core dependency from bigtable-hbase-2.x (#3620) (413a2fd)

Documentation

• Update README to use --enableSnappy flag to import snappy compre… (#3623) (ea73be9)

2.2.0 (2022-05-03)

Features

• log version and settings on startup (#3601) (109023a)
• next release from main branch is 2.2.0 (#3593) (58a6ce4)

Bug Fixes

• disabling incompatible mutation metrics for HBase 1.3 or lower (#3599) (9a693e8)
• published dependencies of bigtable-beam-import (#3600) (0dfb130)

Dependencies

• update dependency net.bytebuddy:byte-buddy to v1.12.10 (#3597) (283cef8)

2.1.1 (2022-04-20)

Bug Fixes

• [hbase-cbt-replication] use instance/project URI in log (#3575) (87d36b3)

Dependencies

• update dependency com.google.cloud:google-cloud-bigtable-emulator to v0.143.2 (#3564) (10e2128)
• update dependency com.google.errorprone:error_prone_annotations to v2.12.1 (#3576) (705741d)
• update dependency com.google.errorprone:error_prone_annotations to v2.13.1 (#3580) (a34a82a)
• update dependency net.bytebuddy:byte-buddy to v1.12.9 (#3578) (31c2268)
• upgrade guava to 31.1-jre and Bigtable to 2.6.2 (#3582) (f9e988d)

2.1.0 (2022-04-01)

Features

• [hase-cbt-replication]Add a metrics for hbase<>bigtable timestamp overflow (#3540) (9c73318)
• Adding a detailed readme for HBase replication support. (#3527) (b406ac5)
• enable dry-run mode for HBase to Cloud Bigtable replication (#3532) (164738b)
• Enable HBase to Cloud Bigtable replication (#3510) (68d4a01)
• flag a put in future timestamp and record a metrics (#3534) (7dd7653)
• remove base repl endpoint from hbase 2.x (#3539) (f748c70)

Bug Fixes

• [hbase-cbt-replication] make hbase2.x endpoint context private (#3559) (5ec3b18)
• consistent behavior of customwalentry filter across hbase1.x and hbase2.x (#3562) (f70b0cb)
• license and notice files for all the shaded artifacts (#3565) (86a5643)
• minor documentation update (#3572) (68db6c2)

Documentation

• fix typos in README and add --region option (#3520) (c189d46)

Dependencies

• update dependency ch.qos.logback:logback-classic to v1.2.11 (#3538) (92e8b63)
• update dependency com.google.cloud:google-cloud-bigtable-emulator to v0.142.3 (#3528) (33a8eba)
• update dependency com.google.cloud:google-cloud-bigtable-emulator to v0.143.0 (#3543) (2d57f14)
• update dependency net.bytebuddy:byte-buddy to v1.12.8 (#3502) (77ae2f1)
• update jmh.version to v1.35 (#3561) (188738d)

2.0.0 (2022-02-11)

This is the first release of Bigtable HBase 2.0.0. The main focus of Bigtable HBase 2.0.0 is to migrate the internal logic from bigtable-client-core to java-bigtable. The primary difference from 1.x.x versions is that bigtable-client-core has been completely removed and CloudBigtableIO has been migrated as well to the java-bigtable client library.

Other notable changes between 1.x.x and 2.0.0 include:

• Deadlines are enabled by default (google.bigtable.rpc.use.timeouts)
• Retry settings have been adjusted as follows:
  • Unary:
    • attempt: 20s
    • operation: 5m
  • Scan / bulkReads:
    • response: 5m
    • attempt 10m
    • operation: forever
  • BulkMutate:
    • attempt: 1m
    • operation (default): 10m
    • operation (BIGTABLE_USE_BATCH=false): 20m
• Error handling has been improved to always be a subclass of IOException and to include the caller’s stack trace for asynchronous calls
• Dependencies have been improved (mapreduce byo-hadoop, etc)
• Minimum supported Java version is Java 8
• Sending metrics to stackdriver is now supported
• Upgraded HBase 1.x to 1.7.1 and HBase 2.x to 2.3.6

You can see all of the changes in our alpha -> beta releases by reading the CHANGELOG.md.

The changes between 2.0.0-beta6 and 2.0.0 are below.

Bug Fixes

• check and mutate should check for existence on empty byte values (#3480) (813c6f0)
• clean up timeout defaults and drop the ability to disable timeouts (#3352) (ad66be0)
• do not use system class loader (#3501) (27ea123)
• filter out results on no-op filters (#3456) (84bf4ca)

Dependencies

• remove explicit auto value dependency in bigtable-beam-import (#3413) (435e072)
• update bigtable veneer to 2.5.1 and shared config to 1.2.6 (#3351) (6741053)
• update bigtable.version to v2.5.2 (#3481) (98e81ad)
• update bigtable.version to v2.5.3 (#3495) (cd62310)
• update dependency com.google.cloud:google-cloud-bigtable-emulator to v0.142.0 (#3431) (fa4843e)
• update dependency com.google.cloud:google-cloud-bigtable-emulator to v0.142.1 (#3440) (dfb7f52)
• update dependency com.google.cloud:google-cloud-bigtable-emulator to v0.142.2 (#3482) (ba471b7)
• update dependency com.google.cloud:google-cloud-bigtable-emulator to v0.142.3 (#3496) (a854cdd)
• update dependency com.google.cloud.bigtable:bigtable-client-core to v1.26.3 (#3505) (4062ab0)
• update dependency com.google.errorprone:error_prone_annotations to v2.11.0 (#3477) (6981aab)
• update dependency net.bytebuddy:byte-buddy to v1.12.7 (#3471) (2beac87)
• update metrics version to 1.26.3, exclude api-common, clean up renovate config (#3504) (2d213ad)
• upgrade hbase2 to 2.3.6 (#3429) (3ce4cbc)

Miscellaneous Chores

• make next release tag 2.0.0 (#3508) (0b8e338)

2.0.0-beta6 (2022-01-06)

Note: This beta release is a work-in-progress. For the latest stable release of java-bigtable-hbase, please refer to version 1.26.2.

Miscellaneous Chores

• bump tag to 2.0.0-beta6 (#3407) (5d2ab98)

Dependencies

• log4j 2.17.0 (#3404) (08a5ebc)
• update beam.version to v2.35.0 (#3420) (be2c629)
• update dependency net.bytebuddy:byte-buddy to v1.12.6 (#3348) (6835f7b)
• update jmh.version to v1.34 (#3415) (16077d2)
• use logback for 1.x tools module (#3412) (cde3f14)

2.0.0-beta5 (2021-12-15)

Note: This beta release is a work-in-progress. For the latest stable release of java-bigtable-hbase, please refer to version 1.26.1.

Dependencies

• remove explicit log4j2 deps on beam artifacts as they are no longer brought in transitively (#3394) (2dafd59)

2.0.0-beta4 (2021-12-14)

Miscellaneous Chores

• make next tag 2.0.0-beta4 (#3387) (01010e9)

Dependencies

• fix: bump log4j2 to 2.16.0 and ban all 2.x.x versions which are < 2.16.0 (#3388) (265f042)

2.0.0-beta3 (2021-12-10)

Note: This beta release is a work-in-progress. For the latest stable release of java-bigtable-hbase, please refer to version 1.26.0.

Bug Fixes

• dynamically load BigtableAdmin and BigtableAsyncAdmin (#3341) (18b2e18)
• fix flow controller setting and option javadocs (#3338) (2d62e34)

Documentation

• fix: Fix paths in HBase tools readme (#3345) (09ba0f3)

Dependencies

• beam 2.33.0 (#3314) (08b4da4)
• migrate to log4j-core (#3326) (001df8e)
• update beam.version to v2.34.0 (#3333) (3bfc672)
• update dependency com.google.cloud:google-cloud-bigtable-emulator to v0.139.0 (#3302) (322d4f9)
• update dependency com.google.cloud:google-cloud-bigtable-emulator to v0.140.0 (#3350) (386f1c5)
• update dependency com.google.cloud:google-cloud-bigtable-emulator to v0.140.1 (#3355) (1ecd396)
• update dependency com.google.cloud:google-cloud-bigtable-emulator to v0.141.0 (#3368) (dfe3f17)
• update dependency com.google.errorprone:error_prone_annotations to v2.10.0 (#3330) (387073f)
• update dependency com.google.guava:guava (#3298) (6b0f56e)
• update log4j2.version to v2.15.0 (#3373) (8eef232)
• upgrade bigtable.version to 2.2.0 (#3304) (1ecdbe9)

Miscellaneous Chores

• make next tag 2.0.0-beta3 (#3374) (6a51dd1)

2.0.0-beta2 (2021-10-19)

Note: This beta release is a work-in-progress. For the latest stable release of java-bigtable-hbase, please refer to version 1.25.0.

Bug Fixes

• fix user agent format (#3288) (49ad39f)

Miscellaneous Chores

• bump next tag to 2.0.0-beta2 (#3283) (8753c30)

Dependencies

• upgrade beam to 2.30.0 (#3284) (05e80e2)
• upgrade hbase1 to 1.7.1 (#3270) (2c5bfe9)

2.0.0-beta1 (2021-10-07)

Note: This beta release is a work-in-progress. For the latest stable release of java-bigtable-hbase, please refer to version 1.25.0.

This is the first beta release of Bigtable HBase 2.0.0. The main focus of Bigtable Hbase 2.0.0 is to migrate the internals from bigtable-client-core to java-bigtable. The primary difference from alpha is that bigtable-client-core has been completely removed and CloudBigtableIO has been migrated as well. This release will remove the configuration available in alpha to switch between the core Bigtable layer (bigtable-client-core) and the java-bigtable client library, and will only use the java-bigtable client to connect to the Bigtable API.

We look forward to hearing your feedback! Please let us know any comments or issues in our issue tracker.

Complete release notes below:

Bug Fixes

• adding validation for snapshot name for hbase import pipeline (#3203) (fa9991a)
• Clean up RowResultAdapter (#3267) (1ccf063)

Dependencies

• update bigtable.version to v2.1.4 (#3246) (8636efb)
• update dependency com.google.cloud:google-cloud-bigtable-emulator to v0.138.4 (#3247) (7a3057f)
• update dependency org.codehaus.plexus:plexus-utils to v3.4.1 (#3249) (dfb729f)
• update jmh.version to v1.33 (#3254) (ce8110e)

Miscellaneous Chores

• bump next tag to 2.0.0-beta1 (#3277) (499d48b)
• make next tag 2.0.0-alpha3 (#3207) (a6241e1)

2.0.0-alpha2 (2021-08-19)

⚠ BREAKING CHANGES

• migrate to java 8 (#3189)

Features

• Add support for renaming tables in schema translator (#3154) (7d49bba)
• migrate to java 8 (#3189) (948b99f)

Miscellaneous Chores

• bump next tag to 2.0.0-alpha2 (#3170) (25c4bfb)

2.0.0-alpha1 (2021-07-19)

Note: This alpha release is a work-in-progress. For the latest stable version of java-bigtable-hbase, please refer to version 1.23.0.

This is the first alpha release of Bigtable HBase 2.0.0. This release switches the core Bigtable layer to the java-bigtable library. This is primarily an implementation detail change. Currently, users can opt out of this via the BIGTABLE_USE_GCJ_CLIENT configuration option to use the existing bigtable-client-core layer. This option is primarily intended for testing during the alpha period. Example:

Configuration configuration = new Configuration(false);
...
configuration.setBoolean(BigtableOptionsFactory.BIGTABLE_USE_GCJ_CLIENT, false);

In future releases, the configuration option to toggle the use of client core on or off will be removed, and the library will no longer use bigtable-client-core to connect to the Bigtable API.

Other notable changes include:

• Deadlines are enabled by default (google.bigtable.rpc.use.timeouts)
• Retry settings have been tweaked (timeouts, exponential backoff)
• Error handling has been improved to always be a subclass of IOException and to include the caller’s stack trace for asynchronous calls
• Dependencies have been improved (mapreduce byo-hadoop, etc)

We look forward to hearing your feedback! Please let us know any comments or issues in our issue tracker.

Complete release notes below:

Features

• Ability to import HBase Snapshot data into Cloud Bigtable using Dataflow (#2755) (5b3ab2b)
• add gcf-owl-bot[bot] to ignoreAuthors (#2974) (96d43d2)
• Add a new pipeline to validate data imported from HBase (#2828) (fa07a90)
• add client-core metrics to veneer (#2978) (68c2773)
• Add keepalive in grpc channelbuilder (#2682) (2a732d2)
• add option to configure tracing cookie (#3021) (228a60e)
• adding client wrapper interfaces (#2406) (1ad48d9)
• adding custom User agent for dataflow jobs. (#2952) (d9843b8)
• enable directpath (#2271) (d384208)
• extend RowCell to include labels field (#2397) (80a85fe)
• implement veneer metrics part 1 - implement MetricsApiTracerAdapter (#2631) (bf8a7e3)
• improve handling when crossing async and sync boundaries (#2976) (0a63256)
• managed backups implementation (#2643) (f7afd50)
• mapreduce snapshot import to cloud bigtable (#2851) (d8ad7dd)
• minimize bloat in mapreduce module (#2895) (0cd7896)
• Schema translator for HBase. (#2901) (da9e036)
• tune default settings to align with java-bigtable (#2439) (4aedcd9)
• use veneer by default (#2980) (aee2f4e)

Bug Fixes

• 1543 One line batch settings (#1950) (2bc252a)
• 1770 Fuzzy keys with integer values above 127 match no rows (#1923) (9802eda)
• 2004 - NPE when calling Watchdog.stop() twice (#2005) (b638828)
• 2788 Using bom files to avoid possible version discrepancy among grpc (#2789) (6e77eac)
• 691 SingleColumnValueFilter NOT_EQUALS empty value not working (#1946) (c5d5c7e)
• add bigtable-hbase version to user agent (#3033) (7c45f2c)
• add extraFiles to 1x branch (#3160) (f6c7824)
• beam warning about accessing template values (#2400) (443a40c), closes #2389
• bigtable-hbase-2.x-hadoop incompatible with hbase-shaded-client 2.x (#2773) (1792c60)
• bigtable-hbase-tools version (#2920) (551b49f)
• BigtableSession is never closed by Reader causing "ManagedChanne… (#2782) (5340db5)
• build: update return codes for build scripts (#2583) (96e8d8e)
• close BigtableInstanceAdminClient and batcher (#2963) (77d5b21)
• conversion from hbase to veneer settings (#2912) (5c12fd8)
• deadlock scenario from BulkReadVeneerApi and fixed flaky tests (#2484) (e4cd4ef)
• dont use channel pools for admin api for veneer (#2917) (d9d54c3)
• enabling the integration test on the correct kokoro target (#2911) (2c5492d)
• fix race condition in auto flush (#2772) (ff8e489)
• fix retry when rowCount == rowsLimit (#2931) (c5da82f)
• hbase 2x shell (bigtable2.0) (#2906) (eb9e756)
• includes fixes for the gap between HBase and this client (#2267) (51f0617)
• keep only failed actions in List (#3020) (aac0522)
• logs: type aligned to in log statement (#2536) (76c41ca)
• manifests in executable jars (#2896) (9736b06)
• max mutation comparison to include 100k (#3008) (5434e5e)
• multithreaded batch operations (#2930) (8c1eb6c)
• qualifier filter comparators (#2684) (#2688) (f57affc)
• race condition where a retry triggers a full table scan (#2758) (8d3bd4d)
• ReadRows not counting the rpc as the first attempt (#2568) (c748f23)
• Refactoring methods in TemplateUtils. Using CamelCasing for names. (#2967) (93a1c2d)
• remove duplicate classic setting parsing (#2918) (b6b44a7)
• remove duplicated cell when interleave filter is applied (#2491) (2915bfd)
• retry rst_stream (#3002) (ace17b7)
• Set a 20 mins timeout for bulk mutations for HBase over Veneer. (#3052) (10a6ce8)
• temporarily disable reporting to unblock releases (#2620) (9611a91)
• the options of CreateTableHelper to be public (#2366) (072ccc9)
• to fix deleteRowRangeByPrefix for integer values above 127 (#2511) (1ae8c03)
• update readRowsAsync to use RetryingReadRowsOperation (#2738) (#2759) (3c4f3b2)
• update url in pom file (#2279) (2e2f638)
• updated assertions and scan for firstKeyOnlyFilter test (#2483) (a2cbe7a)
• use binary search in getRegionLocation (#3044) (48951ab)
• use random with permanent seed (#2722) (a882f9a)
• validation of TimeRange (#1890) (7f404e4)
• veneer adapter batching (#3053) (6768357)
• ZeroCopyByteStringUtil can return incorrect results in some cases (#2628) (1667a40)

Reverts

• Revert "fix: BigtableSession is never closed by Reader causing "ManagedChanne… (#2782)" (#2873) (3568c27)

Miscellaneous Chores

• bump release please to 2.0.0-alpha-1 (#2927) (7b0edcd)
• make release please version 2.0.0-alpha1 (#3155) (890b679)

Documentation

• add javadoc for classes marked as InternalApi (#2350) (c86d7d2)
• Add README for HBase Tools and Beam import/export and validator pipelines (#2949) (e05b548)
• automatically update version numbers with release (#2476) (2ad78e9)
• Fix broken links for HBase Migration tools (#3097) (83238e7)
• fix link to 1x branch in readme (#3161) (b4e1757)
• fix readme title for Bigtable HBase tools (#3013) (de5970d)
• update CONTRIBUTING.md to include code formatting (#534) (#2542) (1c92056)
• Update CONTRIBUTING.md with integration test instructions (#2560) (9b1a6e5)
• update readme to align more with standard templates (#3162) (1721ae1)
• Updated readme to redirect user to veneer client (#2288) (aa9ac47)

Dependencies

• add maven-enforcer-plugin (#2401) (1ef4b9c)
• align bigtable-hbase-1.x-mapreduce to use the same hadoop version as other 1.x modules (#2455) (60a5f82)
• fix dependency build (#2305) (e92fd2e)
• fix hbaseLocalMiniClusterTestH2 tests (#2308) (b7f48f5)
• fix undeclared used dependencies (#2419) (d9b109f)
• fix: add log4j12 to mincluster h2 tests (#2450) (bf5ef7c)
• manually update dependency org.mockito:mockito-core to v3.3.0 (#2392) (918340d)
• Update beam version to 2.24.0 (#2775) (82ca972)
• update bigtable veneer to 1.15.0 (#2630) (9034822)
• update bigtable veneer version to 1.12.2 (#2526) (c422b07)
• update bigtable.version to v1.11.0 (#2395) (50de5d7)
• update bigtable.version to v1.13.0 (#2540) (2167870)
• update bigtable.version to v1.16.1 (#2646) (a48a456)
• update bigtable.version to v1.16.2 (#2654) (ad48fb1)
• update bigtable.version to v1.17.0 (#2668) (15a2f39)
• update bigtable.version to v1.17.1 (#2674) (7ee5f0a)
• update bigtable.version to v1.17.3 (#2695) (75cf25c)
• update bigtable.version to v1.18.0 (#2700) (48a60f6)
• update bigtable.version to v1.19.0 (#2721) (b813bd4)
• update bigtable.version to v1.19.1 (#2763) (b5d9ec2)
• update bigtable.version to v1.19.2 (#2767) (792f7f5)
• update bigtable.version to v1.20.0 (#2829) (098d370)
• update bigtable.version to v1.20.1 (#2843) (c4126da)
• update bigtable.version to v1.21.0 (#2868) (8fbf496)
• update dependency com.fasterxml.jackson.core:jackson-databind to v2.10.2 (#2340) (437557f)
• update dependency com.fasterxml.jackson.core:jackson-databind to v2.10.3 (#2394) (95834d1)
• update dependency com.fasterxml.jackson.core:jackson-databind to v2.11.0 (#2505) (dd8856f)
• update dependency com.fasterxml.jackson.core:jackson-databind to v2.11.1 (#2557) (65373ce)
• update dependency com.fasterxml.jackson.core:jackson-databind to v2.11.2 (#2603) (046affa)
• update dependency com.google.auto.value:auto-value to v1.7.2 (#2513) (409b309)
• update dependency com.google.auto.value:auto-value to v1.7.3 (#2549) (1161524)
• update dependency com.google.auto.value:auto-value to v1.7.4 (#2571) (4dd36a7)
• update dependency com.google.auto.value:auto-value-annotations to v1.7.2 (#2532) (818f435)
• update dependency com.google.auto.value:auto-value-annotations to v1.7.3 (#2550) (218bcbe)
• update dependency com.google.auto.value:auto-value-annotations to v1.7.4 (#2572) (bf79eaf)
• update dependency com.google.cloud:google-cloud-bigtable-emulator to v0.129.0 (#2832) (4a6b1f4)
• update dependency com.google.cloud:google-cloud-bigtable-emulator to v0.129.1 (#2844) (abcdcc3)
• update dependency com.google.cloud:google-cloud-bigtable-emulator to v0.130.0 (#2869) (207be9b)
• update dependency com.google.guava:guava to v30 (#2666) (8289a54)
• update dependency com.google.guava:guava to v30.1-android (#2761) (07f263e)
• update dependency com.google.http-client:google-http-client-jackson2 to v1.35.0 (#2507) (73f5c5e)
• update dependency com.google.http-client:google-http-client-jackson2 to v1.36.0 (#2559) (5567896)
• update dependency com.google.http-client:google-http-client-jackson2 to v1.37.0 (#2652) (64ea0e1)
• update dependency com.google.http-client:google-http-client-jackson2 to v1.38.0 (#2675) (95cde54)
• update dependency com.google.http-client:google-http-client-jackson2 to v1.38.1 (#2802) (442e279)
• update dependency com.google.http-client:google-http-client-jackson2 to v1.39.0 (#2848) (6da8736)
• update dependency commons-codec:commons-codec to v1.14 (#2339) (41a3d98)
• update dependency commons-codec:commons-codec to v1.15 (#2636) (e604c3e)
• update dependency io.grpc:grpc-bom to v1.26.0 (6c616c9)
• update dependency junit:junit to v4.13 (#2335) (92537f0)
• update dependency org.apache.commons:commons-compress to v1.20 (#2376) (65ac9cd)
• update dependency org.codehaus.plexus:plexus-utils to v3.3.0 (#2860) (c6bf393)
• update dependency org.mockito:mockito-core to v3.2.4 (#2290) (2e2e4f9)
• update dependency org.mockito:mockito-core to v3.3.3 (#2414) (e82bc10)
• update dependency org.mockito:mockito-core to v3.4.0 (#2578) (d6a351e)
• update dependency org.mockito:mockito-core to v3.4.6 (#2593) (6fe4fc1)
• update dependency org.mockito:mockito-core to v3.5.13 (#2638) (47741d7)
• update dependency org.mockito:mockito-core to v3.5.15 (#2660) (500eed1)
• update dependency org.mockito:mockito-core to v3.5.7 (#2609) (7c6c3c8)
• update dependency org.slf4j:slf4j-api to v1.7.30 (#2309) (8182b5d)
• update hbase1-hadoop.version to v2.10.1 (#2575) (486589b)
• update jmh.version to v1.22 (#2348) (cdec57f)
• update jmh.version to v1.23 (#2370) (4959c8f)
• update jmh.version to v1.27 (#2739) (b6bf3c7)
• update jmh.version to v1.28 (#2853) (ad7a80b)
• update shared config to 0.9.2 (#2635) (fcdde22)
• upgrade veneer to 1.27.2 (#3056) (5c63d34)
• upgrade veneer to 1.27.3 (#3164) (053398c)