New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Allow longer conversations with mlx. #102

Merged

LaurentMazare merged 1 commit into main from mlx-longer-conversations

Sep 22, 2024

Member

LaurentMazare commented Sep 22, 2024

PR Description

Allow for longer sessions in moshi-mlx:

Switch to rustymimi 0.2.2 where the max-seq-len is 8192 rather than 4096 allowing for 5min40s of conversations (as the mimi transformer runs at 25Hz).
Set the default seq len to 4000 for the main generation routine.


          Allow longer conversations with mlx.

d6b48c2

LaurentMazare mentioned this pull request

Conversation Stopped After a While #51

Open

LaurentMazare merged commit b20815e into main

9 checks passed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet