Dockerized

[codearranger]

Checklist

• Read CONTRIBUTING.md, and accept the CLA by including the provided snippet. We will not accept PR without this.

I, @codearranger, confirm that I have read and understood the terms of the CLA of Kyutai-labs, as outlined in the repository's CONTRIBUTING.md, and I agree to be bound by these terms.

• Run pre-commit hook.

$ pre-commit run --all-files
flake8 on moshi package..................................................Passed
pyright on moshi package.................................................Passed
flake8 on moshi_mlx package..............................................Passed
pyright on moshi_mlx package.............................................Passed

• If you changed Rust code, run cargo check, cargo clippy, cargo test.

PR Description

Added Dockerfiles and docker compose to run the service on a Linux with the NVIDIA Container Toolkit

Docker Server setup

Install the NVIDIA Container Toolkit

https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html

Start the docker container

docker compose up

[adefossez]

Could you add a section in the readme explaining how to use the docker image? Then I can accept the PR.
Thanks a lot!

[codearranger]

@adefossez done

[adefossez]

a few comments before I can merge to be sure I properly understand what is going on.

[adefossez]

what is this version?

[codearranger]

It looks like it's been removed and it's ignored now.

https://docs.docker.com/reference/compose-file/version-and-name/

[adefossez]

i'm not sure how the tunneling is supposed to work, is it on top of the gradio tunnel ? In that case I would remove the gradio flag in the other docker file

[codearranger]

Not on top of, but next to. I use this for all of my deployments. If you add a token then you can have a static URL on your own domain. I left it so people can have options and learn about cloudflare tunnels.

[adefossez]

Thanks a lot, merged!