Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add TGI tests and CI workflow #355

Merged
merged 6 commits into from
Feb 7, 2024
Merged

Add TGI tests and CI workflow #355

merged 6 commits into from
Feb 7, 2024

Conversation

dacorvo
Copy link
Collaborator

@dacorvo dacorvo commented Nov 24, 2023

For now there is a single python test for a small part of the text-generation-server, which is an internal component of the Neuron X TGI image.

Next steps:

  • more python tests,
  • build the image,
  • add docker integration tests.

This allows to build the server outside of the Dockerfile more easily.
Note that when built out of the Dockerfile on Debian/Ubuntu, only the wheel
can be installed.
This might be related to an issue with python-pip.
@dacorvo dacorvo force-pushed the tgi_tests branch 6 times, most recently from 2be8770 to dcbdbb3 Compare February 6, 2024 17:07
@dacorvo dacorvo changed the title Add TGI tests infratructure Add TGI tests and CI workflow Feb 7, 2024
@dacorvo dacorvo marked this pull request as ready for review February 7, 2024 08:45
@dacorvo dacorvo merged commit d2ac20a into main Feb 7, 2024
1 check passed
@dacorvo dacorvo deleted the tgi_tests branch February 7, 2024 09:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants