Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WIP: Dummy PR to check maint-18.0.0 status #44367

Draft
wants to merge 17 commits into
base: main
Choose a base branch
from
Draft

WIP: Dummy PR to check maint-18.0.0 status #44367

wants to merge 17 commits into from

Commits on Oct 10, 2024

  1. GH-44358: [Packaging][Debian] Add workaround for CUDA include path (#…

    …44359)
    
    ### Rationale for this change
    
    This is not happen on Debian GNU/Linux stable and unstable. This is happen only on Debian GNU/Linux testing. So this may be a temporary problem.
    
    ### What changes are included in this PR?
    
    Create a non-existent path manually as a workaround.
    
    ### Are these changes tested?
    
    Yes.
    
    ### Are there any user-facing changes?
    
    Yes.
    * GitHub Issue: #44358
    
    Authored-by: Sutou Kouhei <[email protected]>
    Signed-off-by: Sutou Kouhei <[email protected]>
    kou authored and raulcd committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    c8a0a69 View commit details
    Browse the repository at this point in the history
  2. GH-44347: [Packaging][C++] Enable Azure file system for deb/rpm (#44348)

    ### Rationale for this change
    
    Other file systems such as GCS file system and S3 file system are enabled.
    
    ### What changes are included in this PR?
    
    Enabled Azure file system.
    
    ### Are these changes tested?
    
    Yes.
    
    ### Are there any user-facing changes?
    
    Yes.
    * GitHub Issue: #44347
    
    Authored-by: Sutou Kouhei <[email protected]>
    Signed-off-by: Sutou Kouhei <[email protected]>
    kou authored and raulcd committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    774495c View commit details
    Browse the repository at this point in the history
  3. GH-44355: [Packaging][Python] Disable interactive deb configuration i…

    …n wheel-manylinux-*-cp313t-* (#44362)
    
    ### Rationale for this change
    
    If interactive deb configuration is used, CI is blocked by waiting an user input.
    
    ### What changes are included in this PR?
    
    Disable interactive deb configuration.
    
    ### Are these changes tested?
    
    Yes.
    
    ### Are there any user-facing changes?
    
    No.
    * GitHub Issue: #44355
    
    Authored-by: Sutou Kouhei <[email protected]>
    Signed-off-by: Sutou Kouhei <[email protected]>
    kou authored and raulcd committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    7d5efe5 View commit details
    Browse the repository at this point in the history
  4. GH-43846: [Python][Packaging] Remove numpy dependency from pyarrow pa…

    …ckaging (#44148)
    
    ## WIP
    
    Creating the PR to validate if / what are the CI failures 
    
    ### Rationale for this change
    Once the issue has been merged:
    - #25118
    
    We do not require numpy as a pyarrow dependency.
    
    ### What changes are included in this PR?
    
    Remove numpy as a required dependency
    
    ### Are these changes tested?
    
    Via CI
    
    ### Are there any user-facing changes?
    
    Yes, pyarrow won't install numpy as a required dependency.
    * GitHub Issue: #43846
    
    Authored-by: Raúl Cumplido <[email protected]>
    Signed-off-by: Raúl Cumplido <[email protected]>
    raulcd committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    e15bbe6 View commit details
    Browse the repository at this point in the history
  5. GH-43519: [Python][CI][Packaging] Use released versions to build and …

    …test wheels on Python 3.13 (#44193)
    
    ### Rationale for this change
    
    Now that numpy, cython and pandas all have releases that support Python 3.13, we can remove the extra index and ensure that we are building our wheels with the released version instead of nightly dev version.
    
    * GitHub Issue: #43519
    
    Authored-by: Joris Van den Bossche <[email protected]>
    Signed-off-by: Raúl Cumplido <[email protected]>
    jorisvandenbossche authored and raulcd committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    7d4272e View commit details
    Browse the repository at this point in the history

Commits on Oct 11, 2024

  1. GH-44369: [CI][Python] Remove ds requirement from test collection on …

    …test_dataset.py (#44370)
    
    ### Rationale for this change
    
    If pyarrow has been built without dataset test collection errors due to pytest.mark.parametrize requiring dataset.
    
    ### What changes are included in this PR?
    
    Move dataset requirement outside of test collection by removing it from the parametrization.
    
    ### Are these changes tested?
    
    Via archery
    
    ### Are there any user-facing changes?
    
    No
    * GitHub Issue: #44369
    
    Authored-by: Raúl Cumplido <[email protected]>
    Signed-off-by: Sutou Kouhei <[email protected]>
    raulcd committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    037485f View commit details
    Browse the repository at this point in the history
  2. GH-44314: [Packaging][Python] Use macOS 12 as deployment target to ha…

    …ve macOS 12 pyarrow wheels (#44315)
    
    ### Rationale for this change
    
    We did just bump MACOSX_DEPLOYMENT_TARGET from 10 to 12 for pyarrow wheels on 18.0.0, we probably should wait a little before dropping.
    
    ### What changes are included in this PR?
    
    Revert moving macOS deployment target to 12
    
    ### Are these changes tested?
    
    Will trigger wheel jobs on archery
    
    ### Are there any user-facing changes?
    
    Yes, wheels will be available for macOS 12.
    * GitHub Issue: #44314
    
    Authored-by: Raúl Cumplido <[email protected]>
    Signed-off-by: Sutou Kouhei <[email protected]>
    raulcd committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    bc71843 View commit details
    Browse the repository at this point in the history
  3. GH-44373: [Packaging][Java] Fix brew link to Python 3.13 on macOS (#4…

    …4374)
    
    ### Rationale for this change
    
    Java-jars are currently failing on macOS to install Python 3.13 because `python@ 3.13` (`python` is an alias of `python@ 3.13` now) isn't installed yet. Our link failure workaround is updating already installed `python@*` with `--overwrite` explicitly. `python@ 3.13` (`python`) isn't installed on GitHub Actions runner yet. So `brew bundle` installs `python` without `--overwrite`.
    
    ### What changes are included in this PR?
    
    Install `python` with `--overwrite` explicitly before `brew bundle`.
    
    ### Are these changes tested?
    
    Via CI
    
    ### Are there any user-facing changes?
    
    No
    * GitHub Issue: #44373
    
    Lead-authored-by: Sutou Kouhei <[email protected]>
    Co-authored-by: Raúl Cumplido <[email protected]>
    Signed-off-by: Sutou Kouhei <[email protected]>
    raulcd committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    a39090d View commit details
    Browse the repository at this point in the history
  4. GH-43519: [Python][CI] Add Python 3.13 conda test build (#44192)

    ### Rationale for this change
    
    When adding Python 3.13 support (#43539), conda was not yet ready to support Python 3.13. But over the last weeks most conda packages having being updated, so trying again.
    
    * GitHub Issue: #43519
    
    Authored-by: Joris Van den Bossche <[email protected]>
    Signed-off-by: Raúl Cumplido <[email protected]>
    jorisvandenbossche authored and raulcd committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    71bd117 View commit details
    Browse the repository at this point in the history

Commits on Oct 12, 2024

  1. GH-44381: [Ruby][Release] Pin not only glib but also python on verifi…

    …cation jobs (#44382)
    
    ### Rationale for this change
    
    Verification job is currently failing for Ruby.
    
    ### What changes are included in this PR?
    
    We can't use Python 3.13 and `glib==2.80.5`. So we use old Python as a workaround.
    
    ### Are these changes tested?
    
    Via archery
    
    ### Are there any user-facing changes?
    
    No
    * GitHub Issue: #44381
    
    Lead-authored-by: Sutou Kouhei <[email protected]>
    Co-authored-by: Raúl Cumplido <[email protected]>
    Signed-off-by: Raúl Cumplido <[email protected]>
    raulcd committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    9812ab7 View commit details
    Browse the repository at this point in the history

Commits on Oct 13, 2024

  1. GH-44386: [Integration][Release] Pin Python 3.12 for Integration veri…

    …fication when using Conda (#44388)
    
    ### Rationale for this change
    
    Conda Python 3.13 fails when running verification tasks for Java. It's related to JPype.
    
    See also:
    * GH-44389
    * https://discuss.python.org/t/api-for-python-3-13-prevents-use-of-3rd-party-gc-allocators/62709/5
    
    ### What changes are included in this PR?
    
    Pin Python 3.12 on Conda integration jobs because JPype doesn't work with Python 3.13. We can use Python 3.13 again once JPype supports Python 3.13.
    
    ### Are these changes tested?
    
    Yes via CI
    
    ### Are there any user-facing changes?
    
    No
    * GitHub Issue: #44386
    
    Lead-authored-by: Raúl Cumplido <[email protected]>
    Co-authored-by: Sutou Kouhei <[email protected]>
    Signed-off-by: Sutou Kouhei <[email protected]>
    raulcd and kou committed Oct 13, 2024
    Configuration menu
    Copy the full SHA
    0e184c3 View commit details
    Browse the repository at this point in the history

Commits on Oct 14, 2024

  1. GH-44342: [C++] Disable jemalloc by default on ARM (#44380)

    ### Rationale for this change
    
    jemalloc may have a problem on ARM.
    See also: #44342
    
    ### What changes are included in this PR?
    
    * Disable jemalloc by default on ARM.
    * Disable jemalloc for manylinux wheel for ARM.
    
    ### Are these changes tested?
    
    Yes.
    
    ### Are there any user-facing changes?
    
    Yes.
    
    * GitHub Issue: #44342
    
    Authored-by: Sutou Kouhei <[email protected]>
    Signed-off-by: Raúl Cumplido <[email protected]>
    kou authored and raulcd committed Oct 14, 2024
    Configuration menu
    Copy the full SHA
    155a42e View commit details
    Browse the repository at this point in the history

Commits on Oct 15, 2024

  1. GH-44415: [Release][Ruby] Remove pins from glib section of release ve…

    …rification script (#44407)
    
    ### Rationale for this change
    
    We can remove these pins now that conda-forge/glib-feedstock#191 has been closed. I've tested on my own crossbow and will test here momentarily. This effectively reverts #44270 and #44268.
    
    ### What changes are included in this PR?
    
    Tweaks to release release verification script, specifically removing recently-added pins.
    
    ### Are these changes tested?
    
    Yes: https://github.com/amoeba/crossbow/actions/runs/11335070956/job/31522511285.
    
    ### Are there any user-facing changes?
    
    No.
    
    Closes #44415.
    * GitHub Issue: #44415
    
    Authored-by: Bryce Mecum <[email protected]>
    Signed-off-by: Bryce Mecum <[email protected]>
    amoeba authored and raulcd committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    70a2245 View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2024

  1. GH-44422: [Packaging][Release][Linux] Upload artifacts before test (#…

    …44425)
    
    ### Rationale for this change
    
    It seems that the current `quay.io/centos/centos:stream9` for `linux/aarch64` is broken.
    
    We use it for building and testing but testing is only broken for now. Because we use cached (a bit old) `quay.io/centos/centos:stream9` for now. Building will be failed when the cache is expired.
    
    ### What changes are included in this PR?
    
    Change upload phase to after the build from after the test. Test is still failing but we can proceed our release process by this.
    
    ### Are these changes tested?
    
    Yes.
    
    ### Are there any user-facing changes?
    
    No.
    * GitHub Issue: #44422
    
    Authored-by: Sutou Kouhei <[email protected]>
    Signed-off-by: Raúl Cumplido <[email protected]>
    kou authored and raulcd committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    5d7987b View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    8567163 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    e47bf46 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    9105a41 View commit details
    Browse the repository at this point in the history