CI improvements - Pyodide/WASM

[trallard]

📝 Summary

Expand the CI support for cross-compiling to Pyodide/WebAssembly to at least five projects.

🚀 Tasks / Deliverables

TBD

📅 Estimated completion

24 months milestone

📋 Additional information

Status

Brought over from pyodide/pyodide#3049 (comment)

Package name	Out-of-tree WASM builds	Anaconda.org scheduled uploads
NumPy	✅	✅
PyWavelets	✅	✅
pandas	✅	✅ (pandas-dev/pandas#58647)
awkward and awkward-cpp	✅	Planned
scikit-learn	✅ (improvement via scikit-learn/scikit-learn#29791)	Planned
scikit-image	✅ (setup: scikit-image/scikit-image#7350, improvement: scikit-image/scikit-image#7525)	scikit-image/scikit-image#7440
statsmodels	✅ (setup: statsmodels/statsmodels#9270, improvement: statsmodels/statsmodels#9343)	✅ MacPython/statsmodels-wheels#161
Zarr	zarr-developers/zarr-python#1903, needs pyodide/pyodide#4817 to be released	Planned
numcodecs	zarr-developers/numcodecs#529, stalled by pyodide/pyodide#4779	Planned
SciPy	Planned	Planned
Matplotlib	matplotlib/matplotlib#27870	Planned
h5py and libhdf5	h5py/h5py#2397	Planned
PyTables	Planned	Planned

[rgommers]

Aiming to meet this deliverable within the next 2-4 weeks. Several projects have support (NumPy, PyWavelets, Pandas, scikit-learn), others are in the pipeline (scikit-image, Zarr, Awkward, hopefully also Matplotlib at least). A few others started but on hold due to higher priority items.

Meeting the deliverable won't be the end of it, but we should switch to deploying working interactive docs for a few more projects first, to accelerate the feedback cycle.

[rgommers]

We're getting there! Thanks for adding the detailed issue tracker @agriyakhetarpal

[agriyakhetarpal]

Pyodide's alpha releases for 0.27 are now up, @rgommers – should we now look at zarr-developers/zarr-python#1903 again or wait a bit until we have the stable release a short while after?

[rgommers]

should we now look at zarr-developers/zarr-python#1903 again or wait a bit until we have the stable release a short while after?

The action there is to make async tests for Zarr v3 work, which doesn't depend directly on that PR but (if I understand correctly) is infra work within Pyodide. If there's nothing higher on your prio list, trying to understand that in more detail and moving it forward would be useful I think.