An audio captioning plugin based on LP-MusicCaps.
- Generate captions for all types of audio
- Caption your audio library and make it searchable by using the other nendo search plugins
This plugin requires the manual installation of the LP-MusicCaps
repository from git, run:
git clone https://github.com/seungheondoh/lp-music-caps.git
cd lp-music-caps
pip install -e .
For more information, please refer to the LP-MusicCaps repository.
- Install Nendo
pip install nendo-plugin-caption-lpmusiccaps
Take a look at a basic usage example below. For more detailed information, please refer to the documentation.
>>> from nendo import Nendo
>>> nd = Nendo(plugins=["nendo_plugin_caption_lpmusiccaps"])
>>> track = nd.library.add_track(file_path="path/to/file.mp3")
>>> nd.plugins.caption_lpmusiccaps(track=track)
>>> track.get_plugin_value("caption")
Visit our docs to learn all about how to contribute to Nendo: Contributing
Nendo: MIT License
LP-MusicCaps: CC-BY-NC 4.0 license.
Pretrained models: The weights are released under the CC-BY-NC 4.0 license