-
Notifications
You must be signed in to change notification settings - Fork 3.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
GH-41720: [C++][Acero] Remove an useless parameter for QueryContext::Init called in hash_join_benchmark #41716
Conversation
@zanmato1984 PTAL this? |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
+1. Thanks for catching this!
Though the fix is small enough, I don't think it is a minor change as there is code modification. Could you open an issue and subject this PR to it? Thanks. @ZhangHuiGui |
Can we measure how much The following change will enable the benchmark on "C++ / AMD64 Conda C++ AVX2": diff --git a/docker-compose.yml b/docker-compose.yml
index a1d8f60a26..0c9784cc0d 100644
--- a/docker-compose.yml
+++ b/docker-compose.yml
@@ -285,6 +285,7 @@ services:
environment:
<<: [*common, *ccache, *sccache, *cpp]
ARROW_BUILD_BENCHMARKS: "ON"
+ ARROW_BUILD_OPENMP_BENCHMARKS: "ON"
ARROW_BUILD_EXAMPLES: "ON"
ARROW_ENABLE_TIMING_TESTS: # inherit
ARROW_EXTRA_ERROR_CONTEXT: "ON" |
|
Thanks, added this to current PR, but I’m not sure how to compare it with the previous CI compilation time. |
We can CI logs for it. Anyway... The parameter wasn't used...: https://github.com/apache/arrow/actions/runs/9152098620/job/25159059866?pr=41716#step:6:864 Could you also add this? diff --git a/ci/scripts/cpp_build.sh b/ci/scripts/cpp_build.sh
index a1f40fc360..6a3a53f253 100755
--- a/ci/scripts/cpp_build.sh
+++ b/ci/scripts/cpp_build.sh
@@ -120,6 +120,7 @@ else
-DARROW_BUILD_BENCHMARKS=${ARROW_BUILD_BENCHMARKS:-OFF} \
-DARROW_BUILD_EXAMPLES=${ARROW_BUILD_EXAMPLES:-OFF} \
-DARROW_BUILD_INTEGRATION=${ARROW_BUILD_INTEGRATION:-OFF} \
+ -DARROW_BUILD_OPENMP_BENCHMARKS=${ARROW_BUILD_OPENMP_BENCHMARKS:-OFF} \
-DARROW_BUILD_SHARED=${ARROW_BUILD_SHARED:-ON} \
-DARROW_BUILD_STATIC=${ARROW_BUILD_STATIC:-ON} \
-DARROW_BUILD_TESTS=${ARROW_BUILD_TESTS:-OFF} \ |
off: on: It seems to have decreased a lot... |
It's caused by ccache. The "off" case wasn't cached: https://github.com/apache/arrow/actions/runs/9152098620/job/25159059866?pr=41716#step:6:2944
The "on" case cached: https://github.com/apache/arrow/actions/runs/9154084580/job/25164035145?pr=41716#step:6:2956
I think that about 6min with cache isn't a problem. |
After merging your PR, Conbench analyzed the 7 benchmarking runs that have been run so far on merge-commit c8f89d0. There were 8 benchmark results indicating a performance regression:
The full Conbench report has more details. It also includes information about 47 possible false positives for unstable benchmarks that are known to sometimes produce them. |
…text::Init called in hash_join_benchmark (apache#41716) ### Rationale for this change My local compilation parameters will include the compilation of some basic benchmarks. I discovered this compilation problem today. It seems that apache#41334 of `QueryContext::Init` is not synchronized to `hash_join_benchmark.cc`, and CI has not found this problem. . ### What changes are included in this PR? Remove the first arg . ### Are these changes tested? Needn't ### Are there any user-facing changes? No * GitHub Issue: apache#41720 Lead-authored-by: ZhangHuiGui <[email protected]> Co-authored-by: ZhangHuiGui <[email protected]> Signed-off-by: Antoine Pitrou <[email protected]>
Rationale for this change
My local compilation parameters will include the compilation of some basic benchmarks. I discovered this compilation problem today. It seems that #41334 of
QueryContext::Init
is not synchronized tohash_join_benchmark.cc
, and CI has not found this problem. .What changes are included in this PR?
Remove the first arg .
Are these changes tested?
Needn't
Are there any user-facing changes?
No