Limit z-threads in columnwise_partition

[charleskawczynski]

This should re-close #1854.

[AlexisRenchon]

I wanted to test it on caltech hpc GPU, but I am not sure what to do with:

[arenchon@hpc-25-24 .buildkite]$ julia --project
               _
   _       _ _(_)_     |  Documentation: https://docs.julialang.org
  (_)     | (_) (_)    |
   _ _   _| |_  __ _   |  Type "?" for help, "]?" for Pkg help.
  | | | | | | |/ _` |  |
  | | |_| | | | (_| |  |  Version 1.10.3 (2024-04-30)
 _/ |\__'_|_|_|\__'_|  |  Official https://julialang.org/ release
|__/                   |

(.buildkite) pkg> dev ../../ClimaCore.jl/
   Resolving package versions...
ERROR: Unsatisfiable requirements detected for package ClimaDiagnostics [1ecacbb8]:
 ClimaDiagnostics [1ecacbb8] log:
 ├─possible versions are: 0.0.1-0.2.4 or uninstalled
 └─restricted to versions 0.2.5-0.2 by ClimaLand [08f4d4ce] — no versions left
   └─ClimaLand [08f4d4ce] log:
     ├─possible versions are: 0.14.4 or uninstalled
     └─ClimaLand [08f4d4ce] is fixed to version 0.14.4

[AlexisRenchon]

Seems like something is outdated somewhere? ClimaDiagnostic 0.2.5 should exist

@Sbozzolo

[Sbozzolo]

Seems like something is outdated somewhere? ClimaDiagnostic 0.2.5 should exist

@Sbozzolo

Try add [email protected]

[AlexisRenchon]

Seems like something is outdated somewhere? ClimaDiagnostic 0.2.5 should exist
@Sbozzolo

Try add [email protected]

that worked

[arenchon@hpc-25-24 .buildkite]$ julia --project
               _
   _       _ _(_)_     |  Documentation: https://docs.julialang.org
  (_)     | (_) (_)    |
   _ _   _| |_  __ _   |  Type "?" for help, "]?" for Pkg help.
  | | | | | | |/ _` |  |
  | | |_| | | | (_| |  |  Version 1.10.3 (2024-04-30)
 _/ |\__'_|_|_|\__'_|  |  Official https://julialang.org/ release
|__/                   |

(.buildkite) pkg> add [email protected]
    Updating registry at `~/.julia/registries/General.toml`
   Resolving package versions...
  No Changes to `/central/home/arenchon/GitHub/ClimaLand.jl/.buildkite/Project.toml`
    Updating `/central/home/arenchon/GitHub/ClimaLand.jl/.buildkite/Manifest.toml`
  [8e850b90] ↓ libblastrampoline_jll v5.11.0+0 ⇒ v5.8.0+1

(.buildkite) pkg> dev ../../ClimaCore.jl/
   Resolving package versions...
    Updating `/central/home/arenchon/GitHub/ClimaLand.jl/.buildkite/Project.toml`
  [d414da3d] ~ ClimaCore v0.14.15 ⇒ v0.14.15 `../../ClimaCore.jl`
    Updating `/central/home/arenchon/GitHub/ClimaLand.jl/.buildkite/Manifest.toml`
  [d414da3d] ~ ClimaCore v0.14.15 ⇒ v0.14.15 `../../ClimaCore.jl`

[AlexisRenchon]

The script that was crashing passes on this branch (on caltech hpc gpu).

What now? I imagine ClimaLand CI runs with latest release, so we need a ClimaCore release once this PR is merged?

[Sbozzolo]

The script that was crashing passes on this branch (on caltech hpc gpu).

What now? I imagine ClimaLand CI runs with latest release, so we need a ClimaCore release once this PR is merged?

You can test that ClimaLand CI runs by explicitely checking this branch out.

• Create a new branch in ClimaLand
• Change the pipeline.yml files to pick this branch:

Pkg.add(url = "https://github.com/CliMA/ClimaCore.jl.git", rev = "ck/high_res")

in the instantiation steps

• Manually trigger the builds you are interested in