Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[charry-pick](branch3.0) support text hive #41656

Merged
merged 4 commits into from
Oct 10, 2024
Merged

[charry-pick](branch3.0) support text hive #41656

merged 4 commits into from
Oct 10, 2024
+2,740 −215

Commits on Oct 10, 2024

  1. [feature](hive) support hive write text table (apache#38549) 

    1. Support write hive text table
2. Add SessionVariable `hive_text_compression` to write compressed hive
text table
3. Supported compression type: gzip, bzip2, snappy, lz4, zstd
    @suxiaogang223
    suxiaogang223 committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    0e0b5fb View commit details
    Browse the repository at this point in the history

  2. [fix](decompressor) consider the large_block_len is 0 (apache#40183) 

    followup apache#38549
If the large_block_len is 0, should not continue reading the block_len.
    @suxiaogang223
    suxiaogang223 committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    9f1be79 View commit details
    Browse the repository at this point in the history

  3. [fix](hive) support null_format and escape_char for hive text (apache… 

    …#40291)

## Proposed changes
related pr: apache#39700
support escape.delim and serialization.null.format for hive text
    @suxiaogang223
    suxiaogang223 committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    f603ef7 View commit details
    Browse the repository at this point in the history

  4. [fix](decompressor) impl ZstdDecompressor (apache#40315) 

    Impl ZstdDecompressor and support read hive text table which is
compressed by zstd.
    @suxiaogang223
    suxiaogang223 committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    794c84c View commit details
    Browse the repository at this point in the history