Skip to content

Commit

Permalink
chore: set runAsUser to 0 for ray cluster sample and remove embedding…
Browse files Browse the repository at this point in the history
… for qwen

Signed-off-by: bjwswang <[email protected]>
  • Loading branch information
bjwswang committed Jan 25, 2024
1 parent 83ebf9e commit 778934e
Show file tree
Hide file tree
Showing 3 changed files with 51 additions and 47 deletions.
94 changes: 49 additions & 45 deletions config/samples/ray.io_v1_raycluster.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -13,51 +13,55 @@ spec:
app.kubernetes.io/instance: raycluster
app.kubernetes.io/name: kuberay
spec:
securityContext:
runAsUser: 0
runAsGroup: 0
fsGroup: 0
containers:
- image: kubeagi/ray-ml:2.9.0-py39-vllm
name: ray-head
resources:
limits:
cpu: "1"
memory: 2G
nvidia.com/gpu: 1
requests:
cpu: "1"
memory: 2G
nvidia.com/gpu: 1
volumeMounts:
- mountPath: /tmp/ray
name: log-volume
- image: kubeagi/ray-ml:2.9.0-py39-vllm
name: ray-head
resources:
limits:
cpu: "1"
memory: 2G
nvidia.com/gpu: 1
requests:
cpu: "1"
memory: 2G
nvidia.com/gpu: 1
volumeMounts:
- mountPath: /tmp/ray
name: log-volume
volumes:
- emptyDir: {}
name: log-volume
workerGroupSpecs:
- groupName: workergroup
replicas: 0
minReplicas: 0
maxReplicas: 5
rayStartParams: {}
template:
metadata:
labels:
app.kubernetes.io/instance: raycluster
app.kubernetes.io/name: kuberay
spec:
containers:
- image: kubeagi/ray-ml:2.9.0-py39-vllm
name: ray-worker
resources:
limits:
cpu: "1"
memory: 1G
nvidia.com/gpu: 1
requests:
cpu: "1"
memory: 1G
nvidia.com/gpu: 1
volumeMounts:
- mountPath: /tmp/ray
- emptyDir: {}
name: log-volume
volumes:
- emptyDir: {}
name: log-volume
workerGroupSpecs:
- groupName: workergroup
replicas: 0
minReplicas: 0
maxReplicas: 5
rayStartParams: {}
template:
metadata:
labels:
app.kubernetes.io/instance: raycluster
app.kubernetes.io/name: kuberay
spec:
containers:
- image: kubeagi/ray-ml:2.9.0-py39-vllm
name: ray-worker
resources:
limits:
cpu: "1"
memory: 1G
nvidia.com/gpu: 1
requests:
cpu: "1"
memory: 1G
nvidia.com/gpu: 1
volumeMounts:
- mountPath: /tmp/ray
name: log-volume
volumes:
- emptyDir: {}
name: log-volume
2 changes: 1 addition & 1 deletion deploy/charts/arcadia/Chart.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@ apiVersion: v2
name: arcadia
description: A Helm chart(KubeBB Component) for KubeAGI Arcadia
type: application
version: 0.2.17
version: 0.2.18
appVersion: "0.1.0"

keywords:
Expand Down
2 changes: 1 addition & 1 deletion deploy/charts/arcadia/templates/post-models.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -87,7 +87,7 @@ spec:
arXiv: https://arxiv.org/abs/2309.16609
通义为阿里云大模型的统一品牌,覆盖语言、听觉、多模态等领域,致力于实现类人智慧的通用智能。
types: "llm,embedding"
types: "llm"
---
apiVersion: arcadia.kubeagi.k8s.com.cn/v1alpha1
kind: Model
Expand Down

0 comments on commit 778934e

Please sign in to comment.