Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fine-tuning video captions #76

Open
dvirla opened this issue Mar 19, 2023 · 1 comment
Open

Fine-tuning video captions #76

dvirla opened this issue Mar 19, 2023 · 1 comment

Comments

@dvirla
Copy link

dvirla commented Mar 19, 2023

Thanks for your great work!
I', trying to ,modify the image training code to video captioning fine tuning, but there are somethings that doesn't quite clear to me how to modify like using "answer" parameter in MPLUG model.
Could you please release a train framework for this task?

I'm using vatex_video_caps_dataset class to load my dataset.

Thanks!

@dvirla
Copy link
Author

dvirla commented Mar 19, 2023

I think I've figured it out, I modified the dataset and the train call to pass the real captio as the "answer", is that the right way?
If so, I can create a pull request for you to add this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant