Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(conda): conda environments #1144

Merged
merged 28 commits into from
Nov 4, 2023
Merged

feat(conda): conda environments #1144

merged 28 commits into from
Nov 4, 2023

Commits on Oct 25, 2023

  1. feat(autogptq): add a separate conda environment for autogptq (#1137)

    **Description**
    
    This PR related to #1117
    
    **Notes for Reviewers**
    
    Here we lock down the version of the dependencies. Make sure it can be
    used all the time without failed if the version of dependencies were
    upgraded.
    
    I change the order of importing packages according to the pylint, and no
    change the logic of code. It should be ok.
    
    I will do more investigate on writing some test cases for every backend.
    I can run the service in my environment, but there is not exist a way to
    test it. So, I am not confident on it.
    
    Add a README.md in the `grpc` root. This is the common commands for
    creating `conda` environment. And it can be used to the reference file
    for creating extral gRPC backend document.
    
    Signed-off-by: GitHub <[email protected]>
    Signed-off-by: Ettore Di Giacinto <[email protected]>
    Aisuko authored and mudler committed Oct 25, 2023
    Configuration menu
    Copy the full SHA
    3f7bfa7 View commit details
    Browse the repository at this point in the history
  2. [Extra backend] Add seperate environment for ttsbark (#1141)

    **Description**
    
    This PR relates to #1117
    
    **Notes for Reviewers**
    
    Same to the latest PR:
    * The code is also changed, but only the order of the import package
    parts. And some code comments are also added.
    * Add a configuration of the `conda` environment
    * Add a simple test case for testing if the service can be startup in
    current `conda` environment. It is succeed in VSCode, but the it is not
    out of box on terminal. So, it is hard to say the test case really
    useful.
    
    **[Signed
    commits](../CONTRIBUTING.md#signing-off-on-commits-developer-certificate-of-origin)**
    - [x] Yes, I signed my commits.
    
    <!--
    Thank you for contributing to LocalAI!
    
    Contributing Conventions
    -------------------------
    
    The draft above helps to give a quick overview of your PR.
    
    Remember to remove this comment and to at least:
    
    1. Include descriptive PR titles with [<component-name>] prepended. We
    use [conventional
    commits](https://www.conventionalcommits.org/en/v1.0.0/).
    2. Build and test your changes before submitting a PR (`make build`).
    3. Sign your commits
    4. **Tag maintainer:** for a quicker response, tag the relevant
    maintainer (see below).
    5. **X/Twitter handle:** we announce bigger features on X/Twitter. If
    your PR gets announced, and you'd like a mention, we'll gladly shout you
    out!
    
    By following the community's contribution conventions upfront, the
    review process will
    be accelerated and your PR merged more quickly.
    
    If no one reviews your PR within a few days, please @-mention @mudler.
    -->
    
    Signed-off-by: GitHub <[email protected]>
    Signed-off-by: Ettore Di Giacinto <[email protected]>
    Aisuko authored and mudler committed Oct 25, 2023
    Configuration menu
    Copy the full SHA
    a34cc34 View commit details
    Browse the repository at this point in the history
  3. feat(conda): add make target and entrypoints for the dockerfile

    Signed-off-by: Ettore Di Giacinto <[email protected]>
    mudler committed Oct 25, 2023
    Configuration menu
    Copy the full SHA
    b44f038 View commit details
    Browse the repository at this point in the history
  4. feat(conda): Add seperate conda env for diffusers (#1145)

    **Description**
    
    This PR relates to  #1117
    
    **Notes for Reviewers**
    
    * Add `conda` env `diffusers.yml`
    * Add Makefile to create it automatically
    * Add `run.sh` to support running as a extra backend
      * Also adding it to the main Dockerfile
    * Add make command in the root Makefile
    * Testing the server, it can start up under the env
    
    Signed-off-by: GitHub <[email protected]>
    Signed-off-by: Ettore Di Giacinto <[email protected]>
    Aisuko authored and mudler committed Oct 25, 2023
    Configuration menu
    Copy the full SHA
    947fb26 View commit details
    Browse the repository at this point in the history
  5. feat(conda):Add seperate env for vllm (#1148)

    **Description**
    
    This PR is related to #1117
    
    **Notes for Reviewers**
    
    * The gRPC server can be started as normal
    * The test case can be triggered in VSCode
    * Same to other this kind of PRs, add `vllm.yml` Makefile and add
    `run.sh` to the main Dockerfile, and command to the main Makefile
    
    **[Signed
    commits](../CONTRIBUTING.md#signing-off-on-commits-developer-certificate-of-origin)**
    - [x] Yes, I signed my commits.
    
    <!--
    Thank you for contributing to LocalAI!
    
    Contributing Conventions
    -------------------------
    
    The draft above helps to give a quick overview of your PR.
    
    Remember to remove this comment and to at least:
    
    1. Include descriptive PR titles with [<component-name>] prepended. We
    use [conventional
    commits](https://www.conventionalcommits.org/en/v1.0.0/).
    2. Build and test your changes before submitting a PR (`make build`).
    3. Sign your commits
    4. **Tag maintainer:** for a quicker response, tag the relevant
    maintainer (see below).
    5. **X/Twitter handle:** we announce bigger features on X/Twitter. If
    your PR gets announced, and you'd like a mention, we'll gladly shout you
    out!
    
    By following the community's contribution conventions upfront, the
    review process will
    be accelerated and your PR merged more quickly.
    
    If no one reviews your PR within a few days, please @-mention @mudler.
    -->
    
    Signed-off-by: GitHub <[email protected]>
    Signed-off-by: Ettore Di Giacinto <[email protected]>
    Aisuko authored and mudler committed Oct 25, 2023
    Configuration menu
    Copy the full SHA
    859c693 View commit details
    Browse the repository at this point in the history
  6. feat(conda):Add seperate env for huggingface (#1146)

    **Description**
    
    This PR is related to  #1117
    
    **Notes for Reviewers**
    
    * Add conda env `huggingface.yml`
    * Change the import order, and also remove the no-used packages
    * Add `run.sh` and `make command` to the main Dockerfile and Makefile
    * Add test cases for it. It can be triggered and succeed under VSCode
    Python extension but it is hang by using `python -m unites
    test_huggingface.py` in the terminal
    
    ```
    Running tests (unittest): /workspaces/LocalAI/extra/grpc/huggingface
    Running tests: /workspaces/LocalAI/extra/grpc/huggingface/test_huggingface.py::TestBackendServicer::test_embedding
    /workspaces/LocalAI/extra/grpc/huggingface/test_huggingface.py::TestBackendServicer::test_load_model
    /workspaces/LocalAI/extra/grpc/huggingface/test_huggingface.py::TestBackendServicer::test_server_startup
    ./test_huggingface.py::TestBackendServicer::test_embedding Passed
    
    ./test_huggingface.py::TestBackendServicer::test_load_model Passed
    
    ./test_huggingface.py::TestBackendServicer::test_server_startup Passed
    
    Total number of tests expected to run: 3
    Total number of tests run: 3
    Total number of tests passed: 3
    Total number of tests failed: 0
    Total number of tests failed with errors: 0
    Total number of tests skipped: 0
    
    Finished running tests!
    ```
    
    **[Signed
    commits](../CONTRIBUTING.md#signing-off-on-commits-developer-certificate-of-origin)**
    - [x] Yes, I signed my commits.
    
    <!--
    Thank you for contributing to LocalAI!
    
    Contributing Conventions
    -------------------------
    
    The draft above helps to give a quick overview of your PR.
    
    Remember to remove this comment and to at least:
    
    1. Include descriptive PR titles with [<component-name>] prepended. We
    use [conventional
    commits](https://www.conventionalcommits.org/en/v1.0.0/).
    2. Build and test your changes before submitting a PR (`make build`).
    3. Sign your commits
    4. **Tag maintainer:** for a quicker response, tag the relevant
    maintainer (see below).
    5. **X/Twitter handle:** we announce bigger features on X/Twitter. If
    your PR gets announced, and you'd like a mention, we'll gladly shout you
    out!
    
    By following the community's contribution conventions upfront, the
    review process will
    be accelerated and your PR merged more quickly.
    
    If no one reviews your PR within a few days, please @-mention @mudler.
    -->
    
    Signed-off-by: GitHub <[email protected]>
    Signed-off-by: Ettore Di Giacinto <[email protected]>
    Aisuko authored and mudler committed Oct 25, 2023
    Configuration menu
    Copy the full SHA
    95cbd74 View commit details
    Browse the repository at this point in the history
  7. feat(conda): Add the seperate conda env for VALL-E X (#1147)

    **Description**
    
    This PR is related  to #1117
    
    **Notes for Reviewers**
    
    * The gRPC server cannot start up
    
    ```
    (ttsvalle) @Aisuko ➜ /workspaces/LocalAI (feat/vall-e-x) $ /opt/conda/envs/ttsvalle/bin/python /workspaces/LocalAI/extra/grpc/vall-e-x/ttsvalle.py
    Traceback (most recent call last):
      File "/workspaces/LocalAI/extra/grpc/vall-e-x/ttsvalle.py", line 14, in <module>
        from utils.generation import SAMPLE_RATE, generate_audio, preload_models
    ModuleNotFoundError: No module named 'utils'
    ```
    
    The installation steps follow
    https://github.com/Plachtaa/VALL-E-X#-installation below:
    
    * Under the `ttsvalle` conda env
    
    ```
    git clone https://github.com/Plachtaa/VALL-E-X.git
    cd VALL-E-X
    pip install -r requirements.txt
    ```
    
    **[Signed
    commits](../CONTRIBUTING.md#signing-off-on-commits-developer-certificate-of-origin)**
    - [x] Yes, I signed my commits.
    
    <!--
    Thank you for contributing to LocalAI!
    
    Contributing Conventions
    -------------------------
    
    The draft above helps to give a quick overview of your PR.
    
    Remember to remove this comment and to at least:
    
    1. Include descriptive PR titles with [<component-name>] prepended. We
    use [conventional
    commits](https://www.conventionalcommits.org/en/v1.0.0/).
    2. Build and test your changes before submitting a PR (`make build`).
    3. Sign your commits
    4. **Tag maintainer:** for a quicker response, tag the relevant
    maintainer (see below).
    5. **X/Twitter handle:** we announce bigger features on X/Twitter. If
    your PR gets announced, and you'd like a mention, we'll gladly shout you
    out!
    
    By following the community's contribution conventions upfront, the
    review process will
    be accelerated and your PR merged more quickly.
    
    If no one reviews your PR within a few days, please @-mention @mudler.
    -->
    
    Signed-off-by: GitHub <[email protected]>
    Signed-off-by: Ettore Di Giacinto <[email protected]>
    Aisuko authored and mudler committed Oct 25, 2023
    Configuration menu
    Copy the full SHA
    9f723c7 View commit details
    Browse the repository at this point in the history
  8. fix: set image type

    Signed-off-by: Ettore Di Giacinto <[email protected]>
    mudler committed Oct 25, 2023
    Configuration menu
    Copy the full SHA
    519d13f View commit details
    Browse the repository at this point in the history
  9. feat(conda):Add seperate conda env for exllama (#1149)

    Add seperate env for exllama
    
    Signed-off-by: Aisuko <[email protected]>
    Signed-off-by: Ettore Di Giacinto <[email protected]>
    Aisuko authored and mudler committed Oct 25, 2023
    Configuration menu
    Copy the full SHA
    75a96c7 View commit details
    Browse the repository at this point in the history
  10. Setup conda

    Signed-off-by: Ettore Di Giacinto <[email protected]>
    mudler committed Oct 25, 2023
    Configuration menu
    Copy the full SHA
    fb156b0 View commit details
    Browse the repository at this point in the history

Commits on Oct 26, 2023

  1. Merge branch 'master' into feat/conda

    Signed-off-by: Ettore Di Giacinto <[email protected]>
    mudler authored Oct 26, 2023
    Configuration menu
    Copy the full SHA
    0caaca2 View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2023

  1. Merge branch 'master' into feat/conda

    Signed-off-by: Ettore Di Giacinto <[email protected]>
    mudler authored Oct 30, 2023
    Configuration menu
    Copy the full SHA
    0ee587f View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2023

  1. Configuration menu
    Copy the full SHA
    2c356d7 View commit details
    Browse the repository at this point in the history

Commits on Nov 2, 2023

  1. Set image_type arg

    Signed-off-by: Ettore Di Giacinto <[email protected]>
    mudler committed Nov 2, 2023
    Configuration menu
    Copy the full SHA
    3cbd6cc View commit details
    Browse the repository at this point in the history
  2. ci: prepare only conda env in tests

    Signed-off-by: Ettore Di Giacinto <[email protected]>
    mudler committed Nov 2, 2023
    Configuration menu
    Copy the full SHA
    4b92034 View commit details
    Browse the repository at this point in the history
  3. Dockerfile: comment manual pip calls

    Signed-off-by: Ettore Di Giacinto <[email protected]>
    mudler committed Nov 2, 2023
    Configuration menu
    Copy the full SHA
    3676662 View commit details
    Browse the repository at this point in the history
  4. conda: add conda to PATH

    Signed-off-by: Ettore Di Giacinto <[email protected]>
    mudler committed Nov 2, 2023
    Configuration menu
    Copy the full SHA
    14ba64c View commit details
    Browse the repository at this point in the history

Commits on Nov 3, 2023

  1. fixes

    mudler committed Nov 3, 2023
    Configuration menu
    Copy the full SHA
    84c7b0e View commit details
    Browse the repository at this point in the history
  2. add shebang

    mudler committed Nov 3, 2023
    Configuration menu
    Copy the full SHA
    3ca2157 View commit details
    Browse the repository at this point in the history
  3. Fixups

    Signed-off-by: Ettore Di Giacinto <[email protected]>
    mudler committed Nov 3, 2023
    Configuration menu
    Copy the full SHA
    6fcbde7 View commit details
    Browse the repository at this point in the history
  4. file perms

    Signed-off-by: Ettore Di Giacinto <[email protected]>
    mudler committed Nov 3, 2023
    Configuration menu
    Copy the full SHA
    44435fc View commit details
    Browse the repository at this point in the history

Commits on Nov 4, 2023

  1. debug

    mudler committed Nov 4, 2023
    Configuration menu
    Copy the full SHA
    0736c7d View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    f479160 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    00cbd01 View commit details
    Browse the repository at this point in the history
  4. Rename workflows

    mudler committed Nov 4, 2023
    Configuration menu
    Copy the full SHA
    c262da5 View commit details
    Browse the repository at this point in the history
  5. debug

    mudler committed Nov 4, 2023
    Configuration menu
    Copy the full SHA
    542aaf6 View commit details
    Browse the repository at this point in the history
  6. Fixup conda install

    mudler committed Nov 4, 2023
    Configuration menu
    Copy the full SHA
    9471734 View commit details
    Browse the repository at this point in the history
  7. fixup(wrapper): pass args

    Signed-off-by: Ettore Di Giacinto <[email protected]>
    mudler committed Nov 4, 2023
    Configuration menu
    Copy the full SHA
    bb1bd5d View commit details
    Browse the repository at this point in the history