From f72c705246fd5fe9798996a82fb63a89c4a8d332 Mon Sep 17 00:00:00 2001 From: akshay-anyscale <122416226+akshay-anyscale@users.noreply.github.com> Date: Fri, 21 Jul 2023 11:50:38 -0700 Subject: [PATCH] Update README.md Signed-off-by: akshay-anyscale <122416226+akshay-anyscale@users.noreply.github.com> --- README.md | 10 ++++++++++ 1 file changed, 10 insertions(+) diff --git a/README.md b/README.md index 8b826669..49f3369e 100644 --- a/README.md +++ b/README.md @@ -79,6 +79,16 @@ export OPENAI_API_KEY=... # [PROVIDER]://[MODEL_NAME] aviary query --model amazon/LightGPT --model openai://gpt-3.5-turbo --prompt "How do I make fried rice?" ``` +# Deploying on Anyscale Service + +To deploy an application with one model on an Anyscale Service you can run: + +```shell +anyscale service rollout -f template/service.yaml +``` + +This is setup to run the amazon/LightGPT model, but can be easily modified to run any of the other models in this repo. +In order to query the endpoint, you can modify the `template/request.py` script, replacing the query url with the Service URL found in the Service UI. # Aviary Reference