-
-
Notifications
You must be signed in to change notification settings - Fork 1.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat(conda): conda environments #1144
Commits on Oct 25, 2023
-
feat(autogptq): add a separate conda environment for autogptq (#1137)
**Description** This PR related to #1117 **Notes for Reviewers** Here we lock down the version of the dependencies. Make sure it can be used all the time without failed if the version of dependencies were upgraded. I change the order of importing packages according to the pylint, and no change the logic of code. It should be ok. I will do more investigate on writing some test cases for every backend. I can run the service in my environment, but there is not exist a way to test it. So, I am not confident on it. Add a README.md in the `grpc` root. This is the common commands for creating `conda` environment. And it can be used to the reference file for creating extral gRPC backend document. Signed-off-by: GitHub <[email protected]> Signed-off-by: Ettore Di Giacinto <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 3f7bfa7 - Browse repository at this point
Copy the full SHA 3f7bfa7View commit details -
[Extra backend] Add seperate environment for ttsbark (#1141)
**Description** This PR relates to #1117 **Notes for Reviewers** Same to the latest PR: * The code is also changed, but only the order of the import package parts. And some code comments are also added. * Add a configuration of the `conda` environment * Add a simple test case for testing if the service can be startup in current `conda` environment. It is succeed in VSCode, but the it is not out of box on terminal. So, it is hard to say the test case really useful. **[Signed commits](../CONTRIBUTING.md#signing-off-on-commits-developer-certificate-of-origin)** - [x] Yes, I signed my commits. <!-- Thank you for contributing to LocalAI! Contributing Conventions ------------------------- The draft above helps to give a quick overview of your PR. Remember to remove this comment and to at least: 1. Include descriptive PR titles with [<component-name>] prepended. We use [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/). 2. Build and test your changes before submitting a PR (`make build`). 3. Sign your commits 4. **Tag maintainer:** for a quicker response, tag the relevant maintainer (see below). 5. **X/Twitter handle:** we announce bigger features on X/Twitter. If your PR gets announced, and you'd like a mention, we'll gladly shout you out! By following the community's contribution conventions upfront, the review process will be accelerated and your PR merged more quickly. If no one reviews your PR within a few days, please @-mention @mudler. --> Signed-off-by: GitHub <[email protected]> Signed-off-by: Ettore Di Giacinto <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for a34cc34 - Browse repository at this point
Copy the full SHA a34cc34View commit details -
feat(conda): add make target and entrypoints for the dockerfile
Signed-off-by: Ettore Di Giacinto <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for b44f038 - Browse repository at this point
Copy the full SHA b44f038View commit details -
feat(conda): Add seperate conda env for diffusers (#1145)
**Description** This PR relates to #1117 **Notes for Reviewers** * Add `conda` env `diffusers.yml` * Add Makefile to create it automatically * Add `run.sh` to support running as a extra backend * Also adding it to the main Dockerfile * Add make command in the root Makefile * Testing the server, it can start up under the env Signed-off-by: GitHub <[email protected]> Signed-off-by: Ettore Di Giacinto <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 947fb26 - Browse repository at this point
Copy the full SHA 947fb26View commit details -
feat(conda):Add seperate env for vllm (#1148)
**Description** This PR is related to #1117 **Notes for Reviewers** * The gRPC server can be started as normal * The test case can be triggered in VSCode * Same to other this kind of PRs, add `vllm.yml` Makefile and add `run.sh` to the main Dockerfile, and command to the main Makefile **[Signed commits](../CONTRIBUTING.md#signing-off-on-commits-developer-certificate-of-origin)** - [x] Yes, I signed my commits. <!-- Thank you for contributing to LocalAI! Contributing Conventions ------------------------- The draft above helps to give a quick overview of your PR. Remember to remove this comment and to at least: 1. Include descriptive PR titles with [<component-name>] prepended. We use [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/). 2. Build and test your changes before submitting a PR (`make build`). 3. Sign your commits 4. **Tag maintainer:** for a quicker response, tag the relevant maintainer (see below). 5. **X/Twitter handle:** we announce bigger features on X/Twitter. If your PR gets announced, and you'd like a mention, we'll gladly shout you out! By following the community's contribution conventions upfront, the review process will be accelerated and your PR merged more quickly. If no one reviews your PR within a few days, please @-mention @mudler. --> Signed-off-by: GitHub <[email protected]> Signed-off-by: Ettore Di Giacinto <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 859c693 - Browse repository at this point
Copy the full SHA 859c693View commit details -
feat(conda):Add seperate env for huggingface (#1146)
**Description** This PR is related to #1117 **Notes for Reviewers** * Add conda env `huggingface.yml` * Change the import order, and also remove the no-used packages * Add `run.sh` and `make command` to the main Dockerfile and Makefile * Add test cases for it. It can be triggered and succeed under VSCode Python extension but it is hang by using `python -m unites test_huggingface.py` in the terminal ``` Running tests (unittest): /workspaces/LocalAI/extra/grpc/huggingface Running tests: /workspaces/LocalAI/extra/grpc/huggingface/test_huggingface.py::TestBackendServicer::test_embedding /workspaces/LocalAI/extra/grpc/huggingface/test_huggingface.py::TestBackendServicer::test_load_model /workspaces/LocalAI/extra/grpc/huggingface/test_huggingface.py::TestBackendServicer::test_server_startup ./test_huggingface.py::TestBackendServicer::test_embedding Passed ./test_huggingface.py::TestBackendServicer::test_load_model Passed ./test_huggingface.py::TestBackendServicer::test_server_startup Passed Total number of tests expected to run: 3 Total number of tests run: 3 Total number of tests passed: 3 Total number of tests failed: 0 Total number of tests failed with errors: 0 Total number of tests skipped: 0 Finished running tests! ``` **[Signed commits](../CONTRIBUTING.md#signing-off-on-commits-developer-certificate-of-origin)** - [x] Yes, I signed my commits. <!-- Thank you for contributing to LocalAI! Contributing Conventions ------------------------- The draft above helps to give a quick overview of your PR. Remember to remove this comment and to at least: 1. Include descriptive PR titles with [<component-name>] prepended. We use [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/). 2. Build and test your changes before submitting a PR (`make build`). 3. Sign your commits 4. **Tag maintainer:** for a quicker response, tag the relevant maintainer (see below). 5. **X/Twitter handle:** we announce bigger features on X/Twitter. If your PR gets announced, and you'd like a mention, we'll gladly shout you out! By following the community's contribution conventions upfront, the review process will be accelerated and your PR merged more quickly. If no one reviews your PR within a few days, please @-mention @mudler. --> Signed-off-by: GitHub <[email protected]> Signed-off-by: Ettore Di Giacinto <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 95cbd74 - Browse repository at this point
Copy the full SHA 95cbd74View commit details -
feat(conda): Add the seperate conda env for VALL-E X (#1147)
**Description** This PR is related to #1117 **Notes for Reviewers** * The gRPC server cannot start up ``` (ttsvalle) @Aisuko ➜ /workspaces/LocalAI (feat/vall-e-x) $ /opt/conda/envs/ttsvalle/bin/python /workspaces/LocalAI/extra/grpc/vall-e-x/ttsvalle.py Traceback (most recent call last): File "/workspaces/LocalAI/extra/grpc/vall-e-x/ttsvalle.py", line 14, in <module> from utils.generation import SAMPLE_RATE, generate_audio, preload_models ModuleNotFoundError: No module named 'utils' ``` The installation steps follow https://github.com/Plachtaa/VALL-E-X#-installation below: * Under the `ttsvalle` conda env ``` git clone https://github.com/Plachtaa/VALL-E-X.git cd VALL-E-X pip install -r requirements.txt ``` **[Signed commits](../CONTRIBUTING.md#signing-off-on-commits-developer-certificate-of-origin)** - [x] Yes, I signed my commits. <!-- Thank you for contributing to LocalAI! Contributing Conventions ------------------------- The draft above helps to give a quick overview of your PR. Remember to remove this comment and to at least: 1. Include descriptive PR titles with [<component-name>] prepended. We use [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/). 2. Build and test your changes before submitting a PR (`make build`). 3. Sign your commits 4. **Tag maintainer:** for a quicker response, tag the relevant maintainer (see below). 5. **X/Twitter handle:** we announce bigger features on X/Twitter. If your PR gets announced, and you'd like a mention, we'll gladly shout you out! By following the community's contribution conventions upfront, the review process will be accelerated and your PR merged more quickly. If no one reviews your PR within a few days, please @-mention @mudler. --> Signed-off-by: GitHub <[email protected]> Signed-off-by: Ettore Di Giacinto <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 9f723c7 - Browse repository at this point
Copy the full SHA 9f723c7View commit details -
Signed-off-by: Ettore Di Giacinto <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 519d13f - Browse repository at this point
Copy the full SHA 519d13fView commit details -
feat(conda):Add seperate conda env for exllama (#1149)
Add seperate env for exllama Signed-off-by: Aisuko <[email protected]> Signed-off-by: Ettore Di Giacinto <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 75a96c7 - Browse repository at this point
Copy the full SHA 75a96c7View commit details -
Configuration menu - View commit details
-
Copy full SHA for fb156b0 - Browse repository at this point
Copy the full SHA fb156b0View commit details
Commits on Oct 26, 2023
-
Merge branch 'master' into feat/conda
Signed-off-by: Ettore Di Giacinto <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 0caaca2 - Browse repository at this point
Copy the full SHA 0caaca2View commit details
Commits on Oct 30, 2023
-
Merge branch 'master' into feat/conda
Signed-off-by: Ettore Di Giacinto <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 0ee587f - Browse repository at this point
Copy the full SHA 0ee587fView commit details
Commits on Nov 1, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 2c356d7 - Browse repository at this point
Copy the full SHA 2c356d7View commit details
Commits on Nov 2, 2023
-
Signed-off-by: Ettore Di Giacinto <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 3cbd6cc - Browse repository at this point
Copy the full SHA 3cbd6ccView commit details -
ci: prepare only conda env in tests
Signed-off-by: Ettore Di Giacinto <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 4b92034 - Browse repository at this point
Copy the full SHA 4b92034View commit details -
Dockerfile: comment manual pip calls
Signed-off-by: Ettore Di Giacinto <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 3676662 - Browse repository at this point
Copy the full SHA 3676662View commit details -
Signed-off-by: Ettore Di Giacinto <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 14ba64c - Browse repository at this point
Copy the full SHA 14ba64cView commit details
Commits on Nov 3, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 84c7b0e - Browse repository at this point
Copy the full SHA 84c7b0eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3ca2157 - Browse repository at this point
Copy the full SHA 3ca2157View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6fcbde7 - Browse repository at this point
Copy the full SHA 6fcbde7View commit details -
Configuration menu - View commit details
-
Copy full SHA for 44435fc - Browse repository at this point
Copy the full SHA 44435fcView commit details
Commits on Nov 4, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 0736c7d - Browse repository at this point
Copy the full SHA 0736c7dView commit details -
Configuration menu - View commit details
-
Copy full SHA for f479160 - Browse repository at this point
Copy the full SHA f479160View commit details -
Configuration menu - View commit details
-
Copy full SHA for 00cbd01 - Browse repository at this point
Copy the full SHA 00cbd01View commit details -
Configuration menu - View commit details
-
Copy full SHA for c262da5 - Browse repository at this point
Copy the full SHA c262da5View commit details -
Configuration menu - View commit details
-
Copy full SHA for 542aaf6 - Browse repository at this point
Copy the full SHA 542aaf6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9471734 - Browse repository at this point
Copy the full SHA 9471734View commit details -
Signed-off-by: Ettore Di Giacinto <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for bb1bd5d - Browse repository at this point
Copy the full SHA bb1bd5dView commit details