Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add T5-TTS library #965

Merged
merged 6 commits into from
Oct 15, 2024
Merged

Add T5-TTS library #965

merged 6 commits into from
Oct 15, 2024

Conversation

NielsRogge
Copy link
Contributor

This PR ensures downloads work for https://huggingface.co/SWivid/F5-TTS.

cc @SWivid

Copy link
Contributor

@Wauplin Wauplin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks :)

packages/tasks/src/model-libraries.ts Outdated Show resolved Hide resolved
repoName: "T5-TTS",
repoUrl: "https://github.com/SWivid/F5-TTS",
filter: false,
countDownloads: `path_extension:"safetensors" OR path_extension:"pt"`,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do you know why they went for a solution with both E2_TTS and F5_TTS in the same repo? Doing so doesn't allow for separate counting. If you are in contact with them, would be good to nudge them to split.

The current download rule looks good though, no matter if the models get split in 2 repos are not.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

cc @SWivid would you like to have separate download counts for the E2_TTS and F5_TTS checkpoints?

If yes, then it makes sense to split them up into 2 separate model repositories.

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Would it influences the current spaces using it ?
If not, would like to split it up, otherwise thought it's just OK for having F5 and reproduce E2 there

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes so the current Spaces are assuming both are present in the same model repo, see e.g. https://huggingface.co/spaces/mrfakename/E2-F5-TTS/blob/main/app.py#L53.

So updating that would break existing Spaces

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What I would suggest is:

  1. create a new repo for E2-TTS with E2 checkpoints
  2. open a PR on https://huggingface.co/spaces/mrfakename/E2-F5-TTS to point to the new repo
  3. remove the E2-TTS weights from F5-TTS repo

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Agreed! Seperate repos would be better.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ok, @SWivid would you be up for that?

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

sure, i'll take care of it

Copy link

@SWivid SWivid Oct 14, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@NielsRogge sorry for the delay, just got repo split and E2 removed from F5 repo.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks! Note that both model repos would require library_name: f5-tts for downloads to work.

Copy link
Contributor

@Wauplin Wauplin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks both!

repoName: "F5-TTS",
repoUrl: "https://github.com/SWivid/F5-TTS",
filter: false,
countDownloads: `path_extension:"safetensors"`,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Was it intentional to remove .pt files from the count? IIUC users will download either one or the other but not both, correct?

Copy link
Member

@Vaibhavs10 Vaibhavs10 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🔥

@Wauplin Wauplin merged commit 9cce322 into huggingface:main Oct 15, 2024
3 of 4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants