Skip to content

Commit

Permalink
[util] delete everything related to pygloo
Browse files Browse the repository at this point in the history
pygloo support stops at python 3.8, which ray does not support.
the pygloo package is effectively already dead

Signed-off-by: Lonnie Liu <[email protected]>
  • Loading branch information
aslonnie committed Jul 12, 2024
1 parent 4081c05 commit 9669ca8
Show file tree
Hide file tree
Showing 4 changed files with 4 additions and 918 deletions.
32 changes: 2 additions & 30 deletions doc/source/ray-more-libs/ray-collective.rst
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@ Ray collective communication library

* enables 10x more efficient out-of-band collective communication between Ray actor and task processes,
* operates on both distributed CPUs and GPUs,
* uses NCCL and GLOO as the optional high-performance communication backends,
* uses NCCL as the optional high-performance communication backends,
* is suitable for distributed ML programs on Ray.

Collective Primitives Support Matrix
Expand All @@ -30,68 +30,42 @@ See below the current support matrix for all collective calls with different bac
:header-rows: 1

* - Backend
- `gloo <https://github.com/ray-project/pygloo>`_
-
- `nccl <https://docs.nvidia.com/deeplearning/nccl/user-guide/docs/index.html>`_
-
* - Device
- CPU
- GPU
- CPU
- GPU
* - send
- ✔
- ✘
- ✘
- ✔
* - recv
- ✔
- ✘
- ✘
- ✔
* - broadcast
- ✔
- ✘
- ✘
- ✔
* - allreduce
- ✔
- ✘
- ✘
- ✔
* - reduce
- ✔
- ✘
- ✘
- ✔
* - allgather
- ✔
- ✘
- ✘
- ✔
* - gather
- ✘
- ✘
- ✘
- ✘
* - scatter
- ✘
- ✘
- ✘
- ✘
* - reduce_scatter
- ✔
- ✘
- ✘
- ✔
* - all-to-all
- ✘
- ✘
- ✘
- ✘
* - barrier
- ✔
- ✘
- ✘
- ✔

Expand All @@ -110,12 +84,10 @@ Usage
Installation and Importing
^^^^^^^^^^^^^^^^^^^^^^^^^^

Ray collective library is bundled with the released Ray wheel. Besides Ray, users need to install either `pygloo <https://github.com/ray-project/pygloo>`_
or `cupy <https://docs.cupy.dev/en/stable/install.html>`_ in order to use collective communication with the GLOO and NCCL backend, respectively.
Ray collective library is bundled with the released Ray wheel. Besides Ray, users also need to install `cupy <https://docs.cupy.dev/en/stable/install.html>`_ in order to use collective communication with the NCCL backend.

.. code-block:: python
pip install pygloo
pip install cupy-cudaxxx # replace xxx with the right cuda version in your environment
To use these APIs, import the collective package in your actor/task or driver code via:
Expand Down
9 changes: 2 additions & 7 deletions python/ray/util/collective/collective.py
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,6 @@
from ray.util.collective import types

_NCCL_AVAILABLE = True
_GLOO_AVAILABLE = True

logger = logging.getLogger(__name__)

Expand All @@ -23,18 +22,14 @@
"https://docs.cupy.dev/en/stable/install.html."
)

try:
from ray.util.collective.collective_group.gloo_collective_group import GLOOGroup
except ImportError:
_GLOO_AVAILABLE = False


def nccl_available():
return _NCCL_AVAILABLE


def gloo_available():
return _GLOO_AVAILABLE
# pygloo has no release on Python 3.9+ anymore.
return False


class GroupManager(object):
Expand Down
Loading

0 comments on commit 9669ca8

Please sign in to comment.