Update StringView.h #159

FelixYBW · 2023-03-23T20:56:36Z

data() is used very commonly but unfortunately gcc doesn't generate cmov instruction to it. While this branch can be hardly to predicate depends on the real value. Here we use asm to force to generate cmov instrucitons.

Always compile Substrait (#8)

* hash join * remove extra projection

…esn't release ArrowArrayStream (#16) * ArrowStream::getOutput swallows errors * Also, call release hook after ArrowArrayStream is used

* add date parsing * support extract year * support int32 return type * apply pr_19 use setted pool Parse and store the file format var into SubstraitVeloxPlanConverter

* Filter validation for Parquet reader at runtime * Style * Style * Format Removed special handling for avg (#31) [OPPRO-173] Make batch size configurable (#32) support dwrf format

Fix bigint range (#40)

Remove alias (#46)

* support date type * support date type serilize

Support right semi join type in Substrait.

* Mapping the Substrait function name for Gluten and Spark SQL.

* fix int decoder * fix spark33 TPCDS q13 BigintRange not sort

1. fix rebase variantArrayToVector 2. turn off memory leak check temporarily 3. add varchar varbinary compatiable

* Fix might_contain validate fallback * add struct support

* fix aggregation mask * validate count argument size

2. remove test_filter

Support tiny int, small int and date for IN filter pushdown.

…g data (#145) * Port a patch: Refactor Thrift Transport for Parquet Metadata Access facebookincubator#4160 * Port a patch: Read Parquet Page Header with ThriftStreamingTransport to Fix the Incorrect Header Length facebookincubator#4108

…indow function (#148)

* test * orc support --------- Co-authored-by: zuochunwei <[email protected]>

rui-mo and others added 30 commits March 6, 2023 20:04

Add arrow stream node (#2)

c2a728e

Move arrow abi (#3)

c87bce6

Remove Velox prefixes in Substrait proto files (#6)

0f5f2e0

Support more Substrait-to-Velox conversions and added validations (#7)

7389b63

Always compile Substrait (#8)

[OPPRO-10] Enable hash join in Substrait-to-Velox conversion (#9)

5274b00

* hash join * remove extra projection

[OPPRO-104] Support more cases of filter and its pushdown (#14)

81de8f0

[OPPRO-153] Fix int variant (#17)

fc0e598

[OPPRO-135] ArrowStream::getOutput swallows errors, and destructor do…

ee8e790

…esn't release ArrowArrayStream (#16) * ArrowStream::getOutput swallows errors * Also, call release hook after ArrowArrayStream is used

[OPPRO-104] Support date parsing and extract year (#18)

7f5d451

* add date parsing * support extract year * support int32 return type * apply pr_19 use setted pool Parse and store the file format var into SubstraitVeloxPlanConverter

put the split info into struct

e8eb006

[OPPRO-170] Filter validation for Parquet reader at runtime (#27)

046a517

* Filter validation for Parquet reader at runtime * Style * Style * Format Removed special handling for avg (#31) [OPPRO-173] Make batch size configurable (#32) support dwrf format

Fix null filtering for string type (#35)

ae1649b

Fix IN pushdown and refactor (#36)

5e40a6d

Support selecting subfield from struct (#38)

b429c72

Fix bigint range (#40)

Filter out null for IN (#41)

4920cd9

Remove alias (#46)

[TMP FIX] Fix the invalid access to nulls in final avg (#42)

698556a

Filter out nulls by default (#44)

9ee4994

[OPPRO-233] Add SingularOrList support (#45)

724267f

Fix logic of condition separation and refactor (#47)

f92af8c

Parse options in SingularOrList correctly (#48)

92fa2fc

Use SparkSql functions at most (#49)

0d73d1d

Support Datetype (#50)

083b502

* support date type * support date type serilize

Remove the function registration from Velox validation (#52)

68165b0

Add sort operator support in velox (#51)

5154199

Support right semi join type (#53)

a351650

Support right semi join type in Substrait.

rebase 1020, remove duckdb_reader compile

d952b17

Clear null for partial avg results (#56)

683893b

Mapping the Substrait function name for Gluten and Spark SQL (#55)

8d96085

* Mapping the Substrait function name for Gluten and Spark SQL.

Fix IntDecoder and MultiBigintRange not sort (#58)

1ca9dc5

* fix int decoder * fix spark33 TPCDS q13 BigintRange not sort

Add support for regular anti join (facebookincubator#2906) (#59)

773df28

liujiayi771 and others added 21 commits March 6, 2023 20:07

Enable stddev_pop in validator (#129)

00a091c

Enable var_samp and var_pop in validator (#130)

377c91b

Upgrade Apache Arrow version from 8.0.0 to 11.0.0 (#133)

a687624

Some fixes for filter pushdown (#135)

420332b

rebase 2023/2/27

910c3de

1. fix rebase variantArrayToVector 2. turn off memory leak check temporarily 3. add varchar varbinary compatiable

change dense rank return type to integer (#138)

024077a

Fix might_contain validate fallback and support struct literal (#137)

e33c2f7

* Fix might_contain validate fallback * add struct support

Enable bitwise agg in validator (#140)

7a907ca

Fix aggregation masks and validate the size of count arguments (#142)

6660941

* fix aggregation mask * validate count argument size

1. fix compile

168c6d9

2. remove test_filter

support date_add (#144)

18e1f06

Support more data types for IN filter pushdown (#139)

74643aa

Support tiny int, small int and date for IN filter pushdown.

remove unnecessary CI (#149)

cc26d5a

Check a fallback case in validation: using literal partition key in w…

e7a419c

…indow function (#148)

Support date_diff spark sql function (#151)

13da754

Add trim/ltrim/rtrim SparkSQL function (#150)

dee0636

Fix INVALID_STATE on HashJoin when spill is turned on (#154)

8b1aa51

Fix build failure on Arrow 11's boost verification (#156)

32413fe

[VL] add orc file format support (#158)

37fbac4

* test * orc support --------- Co-authored-by: zuochunwei <[email protected]>

Update StringView.h

fc8d53d

zhejiangxiaomai force-pushed the main branch from 4af2ca6 to 8db85d6 Compare April 1, 2023 01:56

zhejiangxiaomai force-pushed the main branch from 0013b0f to 4da6b3e Compare April 23, 2023 09:14

zhejiangxiaomai force-pushed the main branch from 006526b to 0b50cfd Compare May 11, 2023 12:31

zhejiangxiaomai force-pushed the main branch 3 times, most recently from 7988c5e to 78e96ff Compare July 4, 2023 05:24

zhejiangxiaomai force-pushed the main branch from 61cd058 to 97e308e Compare July 14, 2023 13:27

zhejiangxiaomai force-pushed the main branch from ccb4075 to a42da5f Compare August 1, 2023 03:25

marin-ma added a commit to marin-ma/velox-oap that referenced this pull request Dec 15, 2023

[OPPRO-99] Avoid columnar shuffle fallback (oap-project#159)

d14b2a2

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Update StringView.h #159

Update StringView.h #159

FelixYBW commented Mar 23, 2023

Update StringView.h #159

Are you sure you want to change the base?

Update StringView.h #159

Conversation

FelixYBW commented Mar 23, 2023