-
Notifications
You must be signed in to change notification settings - Fork 47
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[VL] add support for spilling to on-heap memory before spilling to file #356
base: main
Are you sure you want to change the base?
Commits on Jul 3, 2023
-
Folder: scripts, third_party, website, .github
relative pr: Update build dependencies oap-project#185
Configuration menu - View commit details
-
Copy full SHA for 1184743 - Browse repository at this point
Copy the full SHA 1184743View commit details -
relative pr: add decimal column reader support oap-project#254 Add utility method MemoryUsageTracker::highUsage() oap-project#227 Support parquet read case sensitive option oap-project#126 Make varchar and varbinary compatible oap-project#115 Create folder if not exits on HDFS write oap-project#267
Configuration menu - View commit details
-
Copy full SHA for db2b662 - Browse repository at this point
Copy the full SHA db2b662View commit details -
relative pr: Add expand op in velox oap-project#199 Add ValueStreamNode operator oap-project#204 Allow decimal in casting string to int oap-project#215
Configuration menu - View commit details
-
Copy full SHA for 34ce137 - Browse repository at this point
Copy the full SHA 34ce137View commit details -
relative pr: add support for reading ORC oap-project#229 Parquet: Optimize parquet write perf oap-project#238 Expand timestamps in page reader oap-project#260 Add processedStrides and processedSplits metrics oap-project#264
Configuration menu - View commit details
-
Copy full SHA for 871ae83 - Browse repository at this point
Copy the full SHA 871ae83View commit details -
relative pr: Fix hashjoin runtime issue oap-project#106 INVALID_STATE on HashJoin when spill is turned on oap-project#154 SIGABRT on DecimalAvgAggregate<UnscaleLongDecimal, UnscaleShortDecimal> when spilling is engaged oap-project#236 Support kPreceeding & kFollowing for window range frame type oap-project#287
Configuration menu - View commit details
-
Copy full SHA for de7528f - Browse repository at this point
Copy the full SHA de7528fView commit details -
relative pr: Allow decimal in casting string to int oap-project#215 Add mapping from named_struct to row_constructor oap-project#214 Fix semantic issues in cast function oap-project#280
Configuration menu - View commit details
-
Copy full SHA for e7134e3 - Browse repository at this point
Copy the full SHA e7134e3View commit details -
relative pr: Fix replace SparkSQL function oap-project#277 Support kPreceeding & kFollowing for window range frame type oap-project#287 support timestamp hash oap-project#269 Spark sum can overflow oap-project#101 Support float & double types in pmod function oap-project#157 Implement datetime functions in velox/sparksql. oap-project#81 Fix type check in MapFunction oap-project#273 Let function validation fail for lookaround pattern in RE2-based implementation oap-project#124 Register lpad/rpad functions for Spark SQL. oap-project#63 Support substring_index sql function oap-project#189 Fix First/Last aggregate functions intermediate type and support decimal oap-project#245 Support date_add spark sql function oap-project#144
Configuration menu - View commit details
-
Copy full SHA for 44b2919 - Browse repository at this point
Copy the full SHA 44b2919View commit details -
relative pr: Serialize and deserialize RowVector oap-project#250
Configuration menu - View commit details
-
Copy full SHA for 38cb28a - Browse repository at this point
Copy the full SHA 38cb28aView commit details -
relative pr: Check a fallback case in validation: using literal partition key in window function oap-project#148 Fix might_contain validate fallback and support struct literal oap-project#137 Implement datetime functions in velox/sparksql. oap-project#81 Parse options in SingularOrList correctly oap-project#48 Add SingularOrList support oap-project#45 Support if then in filter oap-project#74 Fix semi join output type and support existence join oap-project#67 Support decimal as partition column oap-project#167 Add the window support oap-project#61 Add expand operator oap-project#65 Support more cases of filter and its pushdown oap-project#14
Configuration menu - View commit details
-
Copy full SHA for e94db80 - Browse repository at this point
Copy the full SHA e94db80View commit details -
relative pr: Support more data types for read filter oap-project#139 Fix cast double to decimal oap-project#179 Fix casting from string to decimal oap-project#281 Support cast decimal to int oap-project#177 Fix null on overflow and multiply as spark precision and support cast varchar to decimal oap-project#169 Disable tokenizing the path by dot oap-project#109 Serialize and deserialize RowVector oap-project#250 Support datetime pattern in spark oap-project#94
Configuration menu - View commit details
-
Copy full SHA for d9654f1 - Browse repository at this point
Copy the full SHA d9654f1View commit details -
Configuration menu - View commit details
-
Copy full SHA for ca1be07 - Browse repository at this point
Copy the full SHA ca1be07View commit details -
Configuration menu - View commit details
-
Copy full SHA for 166496d - Browse repository at this point
Copy the full SHA 166496dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 4f8394c - Browse repository at this point
Copy the full SHA 4f8394cView commit details -
Configuration menu - View commit details
-
Copy full SHA for d9c76a0 - Browse repository at this point
Copy the full SHA d9c76a0View commit details -
Configuration menu - View commit details
-
Copy full SHA for 29c0acc - Browse repository at this point
Copy the full SHA 29c0accView commit details -
Fix use pre-build arrow (oap-project#289)
In Ubuntu, thrift will be installed manually in setup scripts, but Arrow still compile thrift, then Velox use system thrift and pre-build arrow/parquet. In Centos, Velox could not found system thrift, so it will compile Arrow and thrift twice. Since Arrow will compile thrift in all environments, lets use these pre-build shared libs to save time and keep toolchain consistency. Support native dependency could be overrided by env variables.
Configuration menu - View commit details
-
Copy full SHA for 63976a9 - Browse repository at this point
Copy the full SHA 63976a9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3e386b9 - Browse repository at this point
Copy the full SHA 3e386b9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8ae1d76 - Browse repository at this point
Copy the full SHA 8ae1d76View commit details -
[DWIO] refactor the reader of dwrf/orc (oap-project#261)
Co-authored-by: zuochunwei <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 9c331a0 - Browse repository at this point
Copy the full SHA 9c331a0View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7e9b9b7 - Browse repository at this point
Copy the full SHA 7e9b9b7View commit details -
Configuration menu - View commit details
-
Copy full SHA for e8084ce - Browse repository at this point
Copy the full SHA e8084ceView commit details -
update dnf cache on centos (oap-project#302)
Signed-off-by: Yuan Zhou <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 9347af7 - Browse repository at this point
Copy the full SHA 9347af7View commit details -
Revert "Fix: use rows.end() instead of rows.size() in functions. (fac…
…ebookincubator#4456)" This reverts commit c69efa5.
Configuration menu - View commit details
-
Copy full SHA for d42da52 - Browse repository at this point
Copy the full SHA d42da52View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2faf17d - Browse repository at this point
Copy the full SHA 2faf17dView commit details -
Fix an incorrect type check issue in parquet reader and validate rege…
…xp_extract_all argument (oap-project#308)
Configuration menu - View commit details
-
Copy full SHA for bcb35ad - Browse repository at this point
Copy the full SHA bcb35adView commit details -
Configuration menu - View commit details
-
Copy full SHA for cbaa882 - Browse repository at this point
Copy the full SHA cbaa882View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9104343 - Browse repository at this point
Copy the full SHA 9104343View commit details -
Configuration menu - View commit details
-
Copy full SHA for 37584f0 - Browse repository at this point
Copy the full SHA 37584f0View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9dff543 - Browse repository at this point
Copy the full SHA 9dff543View commit details -
Co-authored-by: zuochunwei <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for b001065 - Browse repository at this point
Copy the full SHA b001065View commit details -
Configuration menu - View commit details
-
Copy full SHA for 249e152 - Browse repository at this point
Copy the full SHA 249e152View commit details -
s/std::stable_sort/boost::parallel_stable_sort (oap-project#303)
Signed-off-by: Yuan Zhou <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 0d8c2c6 - Browse repository at this point
Copy the full SHA 0d8c2c6View commit details -
Add flag for sort in window (oap-project#321)
* add flag for sort in window op * minor change
Configuration menu - View commit details
-
Copy full SHA for e6f99f0 - Browse repository at this point
Copy the full SHA e6f99f0View commit details -
Fix the core dump issue when reading the written parquet file by velo…
…x parquet writer (oap-project#322) Pick facebookincubator#5322
Configuration menu - View commit details
-
Copy full SHA for 0903e4b - Browse repository at this point
Copy the full SHA 0903e4bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 87b46c9 - Browse repository at this point
Copy the full SHA 87b46c9View commit details -
Fix too much small row group issue in Velox parquet writer (oap-proje…
…ct#326) Co-authored-by: youxiduo <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 0589260 - Browse repository at this point
Copy the full SHA 0589260View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5e7b4b0 - Browse repository at this point
Copy the full SHA 5e7b4b0View commit details -
Configuration menu - View commit details
-
Copy full SHA for cbd91d3 - Browse repository at this point
Copy the full SHA cbd91d3View commit details -
Configuration menu - View commit details
-
Copy full SHA for feafeb3 - Browse repository at this point
Copy the full SHA feafeb3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2bf58aa - Browse repository at this point
Copy the full SHA 2bf58aaView commit details -
Fix velox_parquet_e2e_filter_test CI
Co-authored-by: youxiduo <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for c3a8948 - Browse repository at this point
Copy the full SHA c3a8948View commit details -
Configuration menu - View commit details
-
Copy full SHA for 66dc508 - Browse repository at this point
Copy the full SHA 66dc508View commit details -
Configuration menu - View commit details
-
Copy full SHA for 89b7174 - Browse repository at this point
Copy the full SHA 89b7174View commit details -
Configuration menu - View commit details
-
Copy full SHA for 975aec0 - Browse repository at this point
Copy the full SHA 975aec0View commit details -
Configuration menu - View commit details
-
Copy full SHA for 96b8b85 - Browse repository at this point
Copy the full SHA 96b8b85View commit details -
Quick fix velox UT and format (oap-project#340)
* quick fix velox UT
Configuration menu - View commit details
-
Copy full SHA for b7f0375 - Browse repository at this point
Copy the full SHA b7f0375View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7520160 - Browse repository at this point
Copy the full SHA 7520160View commit details -
Fix decimal add (oap-project#344)
* fix decimal add * remove unused code
Configuration menu - View commit details
-
Copy full SHA for b8d2333 - Browse repository at this point
Copy the full SHA b8d2333View commit details -
Configuration menu - View commit details
-
Copy full SHA for d151629 - Browse repository at this point
Copy the full SHA d151629View commit details
Commits on Jul 4, 2023
-
Revert "ld (oap-project#317)" (oap-project#338)
This reverts commit bb6a570.
Configuration menu - View commit details
-
Copy full SHA for 875d0b9 - Browse repository at this point
Copy the full SHA 875d0b9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 482e4b3 - Browse repository at this point
Copy the full SHA 482e4b3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 43697df - Browse repository at this point
Copy the full SHA 43697dfView commit details -
Configuration menu - View commit details
-
Copy full SHA for 78e96ff - Browse repository at this point
Copy the full SHA 78e96ffView commit details
Commits on Jul 5, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 386f25e - Browse repository at this point
Copy the full SHA 386f25eView commit details -
Fix permission problem (oap-project#352)
Co-authored-by: ‘zhaozhenhui’ <‘[email protected]’>
Configuration menu - View commit details
-
Copy full SHA for 4e95d70 - Browse repository at this point
Copy the full SHA 4e95d70View commit details
Commits on Jul 6, 2023
-
Configuration menu - View commit details
-
Copy full SHA for da13c97 - Browse repository at this point
Copy the full SHA da13c97View commit details -
Configuration menu - View commit details
-
Copy full SHA for a62ddb3 - Browse repository at this point
Copy the full SHA a62ddb3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 68be4e0 - Browse repository at this point
Copy the full SHA 68be4e0View commit details
Commits on Jul 7, 2023
-
zuochunwei committed
Jul 7, 2023 Configuration menu - View commit details
-
Copy full SHA for 8aad40e - Browse repository at this point
Copy the full SHA 8aad40eView commit details