Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update StringView.h #159

Open
wants to merge 114 commits into
base: main
Choose a base branch
from
Open

Update StringView.h #159

wants to merge 114 commits into from

Commits on Mar 6, 2023

  1. Add arrow stream node (#2)

    rui-mo authored and zhejiangxiaomai committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    c2a728e View commit details
    Browse the repository at this point in the history
  2. Move arrow abi (#3)

    rui-mo authored and zhejiangxiaomai committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    c87bce6 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    0f5f2e0 View commit details
    Browse the repository at this point in the history
  4. Support more Substrait-to-Velox conversions and added validations (#7)

    Always compile Substrait (#8)
    rui-mo authored and zhejiangxiaomai committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    7389b63 View commit details
    Browse the repository at this point in the history
  5. [OPPRO-10] Enable hash join in Substrait-to-Velox conversion (#9)

    * hash join
    
    * remove extra projection
    marin-ma authored and zhejiangxiaomai committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    5274b00 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    81de8f0 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    fc0e598 View commit details
    Browse the repository at this point in the history
  8. [OPPRO-135] ArrowStream::getOutput swallows errors, and destructor do…

    …esn't release ArrowArrayStream (#16)
    
    * ArrowStream::getOutput swallows errors
    
    * Also, call release hook after ArrowArrayStream is used
    zhztheplayer authored and zhejiangxiaomai committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    ee8e790 View commit details
    Browse the repository at this point in the history
  9. [OPPRO-104] Support date parsing and extract year (#18)

    * add date parsing
    
    * support extract year
    
    * support int32 return type
    
    * apply pr_19
    
    use setted pool
    
    Parse and store the file format var into SubstraitVeloxPlanConverter
    rui-mo authored and zhejiangxiaomai committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    7f5d451 View commit details
    Browse the repository at this point in the history
  10. put the split info into struct

    JkSelf authored and zhejiangxiaomai committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    e8eb006 View commit details
    Browse the repository at this point in the history
  11. [OPPRO-170] Filter validation for Parquet reader at runtime (#27)

    * Filter validation for Parquet reader at runtime
    
    * Style
    
    * Style
    
    * Format
    
    Removed special handling for avg (#31)
    
    [OPPRO-173] Make batch size configurable (#32)
    
    support dwrf format
    zhztheplayer authored and zhejiangxiaomai committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    046a517 View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    ae1649b View commit details
    Browse the repository at this point in the history
  13. Configuration menu
    Copy the full SHA
    5e40a6d View commit details
    Browse the repository at this point in the history
  14. Support selecting subfield from struct (#38)

    Fix bigint range (#40)
    rui-mo authored and zhejiangxiaomai committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    b429c72 View commit details
    Browse the repository at this point in the history
  15. Filter out null for IN (#41)

    Remove alias (#46)
    rui-mo authored and zhejiangxiaomai committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    4920cd9 View commit details
    Browse the repository at this point in the history
  16. Configuration menu
    Copy the full SHA
    698556a View commit details
    Browse the repository at this point in the history
  17. Configuration menu
    Copy the full SHA
    9ee4994 View commit details
    Browse the repository at this point in the history
  18. Configuration menu
    Copy the full SHA
    724267f View commit details
    Browse the repository at this point in the history
  19. Configuration menu
    Copy the full SHA
    f92af8c View commit details
    Browse the repository at this point in the history
  20. Configuration menu
    Copy the full SHA
    92fa2fc View commit details
    Browse the repository at this point in the history
  21. Configuration menu
    Copy the full SHA
    0d73d1d View commit details
    Browse the repository at this point in the history
  22. Support Datetype (#50)

    * support date type
    * support date type serilize
    jinchengchenghh authored and zhejiangxiaomai committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    083b502 View commit details
    Browse the repository at this point in the history
  23. Configuration menu
    Copy the full SHA
    68165b0 View commit details
    Browse the repository at this point in the history
  24. Configuration menu
    Copy the full SHA
    5154199 View commit details
    Browse the repository at this point in the history
  25. Support right semi join type (#53)

    Support right semi join type in Substrait.
    rui-mo authored and zhejiangxiaomai committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    a351650 View commit details
    Browse the repository at this point in the history
  26. Configuration menu
    Copy the full SHA
    d952b17 View commit details
    Browse the repository at this point in the history
  27. Configuration menu
    Copy the full SHA
    683893b View commit details
    Browse the repository at this point in the history
  28. Mapping the Substrait function name for Gluten and Spark SQL (#55)

    
    * Mapping the Substrait function name for Gluten and Spark SQL.
    lviiii authored and zhejiangxiaomai committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    8d96085 View commit details
    Browse the repository at this point in the history
  29. Fix IntDecoder and MultiBigintRange not sort (#58)

    * fix int decoder
    
    * fix spark33 TPCDS q13 BigintRange not sort
    jinchengchenghh authored and zhejiangxiaomai committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    1ca9dc5 View commit details
    Browse the repository at this point in the history
  30. Configuration menu
    Copy the full SHA
    773df28 View commit details
    Browse the repository at this point in the history
  31. Configuration menu
    Copy the full SHA
    ab96fa1 View commit details
    Browse the repository at this point in the history
  32. remove website (#60)

    Signed-off-by: Yuan Zhou <[email protected]>
    
    Signed-off-by: Yuan Zhou <[email protected]>
    zhouyuan authored and zhejiangxiaomai committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    bcc61dc View commit details
    Browse the repository at this point in the history
  33. Fallback cast from array (#62)

    rui-mo authored and zhejiangxiaomai committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    3ea3def View commit details
    Browse the repository at this point in the history
  34. Configuration menu
    Copy the full SHA
    8caad7c View commit details
    Browse the repository at this point in the history
  35. Configuration menu
    Copy the full SHA
    c89e777 View commit details
    Browse the repository at this point in the history
  36. Configuration menu
    Copy the full SHA
    40a502f View commit details
    Browse the repository at this point in the history
  37. add expand operator (#65)

    Add expand operator support in Velox
    JkSelf authored and zhejiangxiaomai committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    4e0fcfb View commit details
    Browse the repository at this point in the history
  38. Configuration menu
    Copy the full SHA
    0e53fd5 View commit details
    Browse the repository at this point in the history
  39. Configuration menu
    Copy the full SHA
    0d36413 View commit details
    Browse the repository at this point in the history
  40. rebase velox to 11.18

    ‘zhaozhenhui’ authored and zhejiangxiaomai committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    bfc56e9 View commit details
    Browse the repository at this point in the history
  41. Configuration menu
    Copy the full SHA
    df5f686 View commit details
    Browse the repository at this point in the history
  42. Configuration menu
    Copy the full SHA
    d537fe1 View commit details
    Browse the repository at this point in the history
  43. Configuration menu
    Copy the full SHA
    90251bd View commit details
    Browse the repository at this point in the history
  44. Configuration menu
    Copy the full SHA
    4cfd75a View commit details
    Browse the repository at this point in the history
  45. pass UT compile and remove website (#82)

    Co-authored-by: ‘zhaozhenhui’ <‘[email protected]’>
    zhejiangxiaomai and ‘zhaozhenhui’ committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    1d6d17a View commit details
    Browse the repository at this point in the history
  46. Configuration menu
    Copy the full SHA
    4545f75 View commit details
    Browse the repository at this point in the history
  47. Configuration menu
    Copy the full SHA
    6557134 View commit details
    Browse the repository at this point in the history
  48. compile unit tests on each pull request (#86)

    * compile unit tests on each pull request
    
    Signed-off-by: Yuan Zhou <[email protected]>
    
    * Update unittest.yml
    
    add ./scripts/setup-ubuntu.sh
    
    * Update unittest.yml
    
    add -DVELOX_ENABLE_ARROW=ON
    
    Signed-off-by: Yuan Zhou <[email protected]>
    Co-authored-by: zhejiangxiaomai <[email protected]>
    zhouyuan and zhejiangxiaomai committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    6c807fc View commit details
    Browse the repository at this point in the history
  49. Configuration menu
    Copy the full SHA
    27f03b9 View commit details
    Browse the repository at this point in the history
  50. Configuration menu
    Copy the full SHA
    8fc23c9 View commit details
    Browse the repository at this point in the history
  51. Configuration menu
    Copy the full SHA
    81b68da View commit details
    Browse the repository at this point in the history
  52. Configuration menu
    Copy the full SHA
    353789f View commit details
    Browse the repository at this point in the history
  53. Configuration menu
    Copy the full SHA
    a3d950f View commit details
    Browse the repository at this point in the history
  54. Configuration menu
    Copy the full SHA
    05be7d8 View commit details
    Browse the repository at this point in the history
  55. Configuration menu
    Copy the full SHA
    46128cb View commit details
    Browse the repository at this point in the history
  56. support no month/day (#94)

    marin-ma authored and zhejiangxiaomai committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    bc5ddd2 View commit details
    Browse the repository at this point in the history
  57. Add window support (#61)

    JkSelf authored and zhejiangxiaomai committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    f5797a0 View commit details
    Browse the repository at this point in the history
  58. Fix half up in round (#95)

    rui-mo authored and zhejiangxiaomai committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    bd54ea3 View commit details
    Browse the repository at this point in the history
  59. Add SMJ support (#97)

    JkSelf authored and zhejiangxiaomai committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    b1c66a6 View commit details
    Browse the repository at this point in the history
  60. Configuration menu
    Copy the full SHA
    b0e4bcb View commit details
    Browse the repository at this point in the history
  61. Configuration menu
    Copy the full SHA
    c195544 View commit details
    Browse the repository at this point in the history
  62. Configuration menu
    Copy the full SHA
    2ebfbdc View commit details
    Browse the repository at this point in the history
  63. rebase 1221

    zhejiangxiaomai committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    aad4b8d View commit details
    Browse the repository at this point in the history
  64. Configuration menu
    Copy the full SHA
    f6eca15 View commit details
    Browse the repository at this point in the history
  65. Configuration menu
    Copy the full SHA
    622d3f8 View commit details
    Browse the repository at this point in the history
  66. Configuration menu
    Copy the full SHA
    a5093f0 View commit details
    Browse the repository at this point in the history
  67. Configuration menu
    Copy the full SHA
    389e534 View commit details
    Browse the repository at this point in the history
  68. rebase 1.3

    zhejiangxiaomai committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    a043636 View commit details
    Browse the repository at this point in the history
  69. Configuration menu
    Copy the full SHA
    9b471db View commit details
    Browse the repository at this point in the history
  70. Fix nullaware anti

    marin-ma authored and zhejiangxiaomai committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    c50732d View commit details
    Browse the repository at this point in the history
  71. add literal validate

    zhejiangxiaomai committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    9c06c9a View commit details
    Browse the repository at this point in the history
  72. Configuration menu
    Copy the full SHA
    7840315 View commit details
    Browse the repository at this point in the history
  73. Configuration menu
    Copy the full SHA
    9a8d32f View commit details
    Browse the repository at this point in the history
  74. Configuration menu
    Copy the full SHA
    426ca38 View commit details
    Browse the repository at this point in the history
  75. Configuration menu
    Copy the full SHA
    63481cc View commit details
    Browse the repository at this point in the history
  76. Configuration menu
    Copy the full SHA
    d49eb88 View commit details
    Browse the repository at this point in the history
  77. Configuration menu
    Copy the full SHA
    9c10e16 View commit details
    Browse the repository at this point in the history
  78. Configuration menu
    Copy the full SHA
    dc1dacd View commit details
    Browse the repository at this point in the history
  79. Configuration menu
    Copy the full SHA
    051700d View commit details
    Browse the repository at this point in the history
  80. [OPPRO-279] Add bloom_filter_agg and might_contain SparkSql function (#…

    …79)
    
    * add sparksql function bloom_filter_agg and might_contain
    
    Change bit_ size to fix TPCDS performance
    
    * change to statefil function
    
    * optimize MightContain
    
    * change back to spark value
    
    * fix merge bloomfilter
    
    * remove comment
    jinchengchenghh authored and zhejiangxiaomai committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    aa36c78 View commit details
    Browse the repository at this point in the history
  81. rebase to 2023/1/11

    zhejiangxiaomai committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    77e31fc View commit details
    Browse the repository at this point in the history
  82. Configuration menu
    Copy the full SHA
    ab34610 View commit details
    Browse the repository at this point in the history
  83. Configuration menu
    Copy the full SHA
    6f82ad7 View commit details
    Browse the repository at this point in the history
  84. Configuration menu
    Copy the full SHA
    e74f47c View commit details
    Browse the repository at this point in the history
  85. Configuration menu
    Copy the full SHA
    18c8e06 View commit details
    Browse the repository at this point in the history
  86. rebase 2023/01/31

    zhejiangxiaomai committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    2ef4929 View commit details
    Browse the repository at this point in the history
  87. Configuration menu
    Copy the full SHA
    9ff9026 View commit details
    Browse the repository at this point in the history
  88. Configuration menu
    Copy the full SHA
    14043f9 View commit details
    Browse the repository at this point in the history
  89. Configuration menu
    Copy the full SHA
    83d0adb View commit details
    Browse the repository at this point in the history
  90. Configuration menu
    Copy the full SHA
    c569b34 View commit details
    Browse the repository at this point in the history
  91. Configuration menu
    Copy the full SHA
    e14ca41 View commit details
    Browse the repository at this point in the history
  92. Configuration menu
    Copy the full SHA
    85f90ef View commit details
    Browse the repository at this point in the history
  93. Configuration menu
    Copy the full SHA
    e989bf5 View commit details
    Browse the repository at this point in the history
  94. Configuration menu
    Copy the full SHA
    00a091c View commit details
    Browse the repository at this point in the history
  95. Configuration menu
    Copy the full SHA
    377c91b View commit details
    Browse the repository at this point in the history
  96. Configuration menu
    Copy the full SHA
    a687624 View commit details
    Browse the repository at this point in the history
  97. Configuration menu
    Copy the full SHA
    420332b View commit details
    Browse the repository at this point in the history
  98. rebase 2023/2/27

    1. fix rebase variantArrayToVector
    2. turn off memory leak check temporarily
    3. add varchar varbinary compatiable
    ‘zhaozhenhui’ authored and zhejiangxiaomai committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    910c3de View commit details
    Browse the repository at this point in the history
  99. Configuration menu
    Copy the full SHA
    024077a View commit details
    Browse the repository at this point in the history
  100. Fix might_contain validate fallback and support struct literal (#137)

    * Fix might_contain validate fallback
    * add struct support
    jinchengchenghh authored and zhejiangxiaomai committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    e33c2f7 View commit details
    Browse the repository at this point in the history
  101. Configuration menu
    Copy the full SHA
    7a907ca View commit details
    Browse the repository at this point in the history
  102. Fix aggregation masks and validate the size of count arguments (#142)

    * fix aggregation mask
    
    * validate count argument size
    rui-mo authored and zhejiangxiaomai committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    6660941 View commit details
    Browse the repository at this point in the history

Commits on Mar 8, 2023

  1. 1. fix compile

    2. remove test_filter
    izchen authored and zhejiangxiaomai committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    168c6d9 View commit details
    Browse the repository at this point in the history
  2. support date_add (#144)

    rui-mo authored and zhejiangxiaomai committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    18e1f06 View commit details
    Browse the repository at this point in the history
  3. Support more data types for IN filter pushdown (#139)

    Support tiny int, small int and date for IN filter pushdown.
    PHILO-HE authored and zhejiangxiaomai committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    74643aa View commit details
    Browse the repository at this point in the history
  4. Port upstream patch to fix parquet reader issue on long min/max strin…

    …g data (#145)
    
    * Port a patch: Refactor Thrift Transport for Parquet Metadata Access facebookincubator#4160
    
    * Port a patch: Read Parquet Page Header with ThriftStreamingTransport to Fix the Incorrect Header Length facebookincubator#4108
    PHILO-HE authored and zhejiangxiaomai committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    4a1b2ee View commit details
    Browse the repository at this point in the history

Commits on Mar 10, 2023

  1. Configuration menu
    Copy the full SHA
    cc26d5a View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    e7a419c View commit details
    Browse the repository at this point in the history

Commits on Mar 14, 2023

  1. Configuration menu
    Copy the full SHA
    13da754 View commit details
    Browse the repository at this point in the history

Commits on Mar 15, 2023

  1. Configuration menu
    Copy the full SHA
    dee0636 View commit details
    Browse the repository at this point in the history

Commits on Mar 22, 2023

  1. Configuration menu
    Copy the full SHA
    8b1aa51 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    32413fe View commit details
    Browse the repository at this point in the history

Commits on Mar 23, 2023

  1. [VL] add orc file format support (#158)

    * test
    
    * orc support
    
    ---------
    
    Co-authored-by: zuochunwei <[email protected]>
    zuochunwei and zuochunwei authored Mar 23, 2023
    Configuration menu
    Copy the full SHA
    37fbac4 View commit details
    Browse the repository at this point in the history
  2. Update StringView.h

    FelixYBW authored Mar 23, 2023
    Configuration menu
    Copy the full SHA
    fc8d53d View commit details
    Browse the repository at this point in the history