Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Multinode serving #574

Draft
wants to merge 91 commits into
base: main
Choose a base branch
from

vllm worker doesn't get ray cluster size

02b0d89
Select commit
Loading
Failed to load commit list.
Draft

Multinode serving #574

vllm worker doesn't get ray cluster size
02b0d89
Select commit
Loading
Failed to load commit list.
Socket Security / Socket Security: Pull Request Alerts succeeded Sep 28, 2024 in 4s

Pull Request #574 Alerts: Skipped

Report Status Message
PR #574 Alerts Pull request contains no dependency changes

Pull request alerts notify when new issues are detected between the diff of the pull request and it's target branch.

Details

No dependency changes detected. Learn more about Socket for GitHub ↗︎

👍 No dependency changes detected in pull request