Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GH-41725: [Python] CMake: ignore Parquet encryption option if Parquet itself is not enabled (fix Java integration build) #41776

Merged
merged 4 commits into from
May 22, 2024

Conversation

jorisvandenbossche
Copy link
Member

@jorisvandenbossche jorisvandenbossche commented May 22, 2024

Rationale for this change

Because of refactoring in #41480, explicitly enabling PYARROW_WITH_PARQUET_ENCRYPTION without enabling PYARROW_WITH_PARQUET (and without Arrow C++ being built with Parquet support) now raises an error, while before we checked in setup.py that both were enabled for enabling encryption support. This patch mimics that logic in CMakeLists.txt with a warning added.

What changes are included in this PR?

When PyArrow with Parquet Encryption is enabled but PyArrow with Parquet itself is not, ignore the encryption setting, but warn about it.

Are these changes tested?

Yes

…sabled (same as base parquwet) - fix Java integration build
Copy link

⚠️ GitHub issue #41725 has been automatically assigned in GitHub to PR creator.

@github-actions github-actions bot added the awaiting committer review Awaiting committer review label May 22, 2024
@jorisvandenbossche jorisvandenbossche changed the title GH-41725: [CI][Python] Default to pyarrow parquet encryption disabled (same as base parquet) in python_build.sh - fix Java integration build GH-41725: [Python] CMake: ignore Parquet encryption option if Parquet itself is not enabled (fix Java integration build) May 22, 2024
@jorisvandenbossche
Copy link
Member Author

This seems to work, the Java C Data Integration build is working again (and showing the cmake warning; I could fix that warning but not entirely sure I should just disable parquet encryption by default in python_build.sh, as some CI builds might be relying on this)

Copy link
Member

@kou kou left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@github-actions github-actions bot added awaiting merge Awaiting merge and removed awaiting committer review Awaiting committer review labels May 22, 2024
@kou kou merged commit 9bd0ddb into apache:main May 22, 2024
12 checks passed
@kou kou removed the awaiting merge Awaiting merge label May 22, 2024
@jorisvandenbossche jorisvandenbossche deleted the gh-41725 branch May 22, 2024 21:16
Copy link

After merging your PR, Conbench analyzed the 7 benchmarking runs that have been run so far on merge-commit 9bd0ddb.

There was 1 benchmark result indicating a performance regression:

The full Conbench report has more details. It also includes information about 2 possible false positives for unstable benchmarks that are known to sometimes produce them.

vibhatha pushed a commit to vibhatha/arrow that referenced this pull request May 25, 2024
…arquet itself is not enabled (fix Java integration build) (apache#41776)

### Rationale for this change

Because of refactoring in apache#41480, explicitly enabling `PYARROW_WITH_PARQUET_ENCRYPTION` without enabling `PYARROW_WITH_PARQUET` (and without Arrow C++ being built with Parquet support) now raises an error, while before we checked in `setup.py` that both were enabled for enabling encryption support. This patch mimics that logic in CMakeLists.txt with a warning added.

### What changes are included in this PR?

When PyArrow with Parquet Encryption is enabled but PyArrow with Parquet itself is not, ignore the encryption setting, but warn about it.

### Are these changes tested?

Yes

* GitHub Issue: apache#41725

Authored-by: Joris Van den Bossche <[email protected]>
Signed-off-by: Sutou Kouhei <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants