Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

What is the pre-training model that the program is based on #5

Open
HangboZhu opened this issue Nov 2, 2023 · 2 comments
Open

What is the pre-training model that the program is based on #5

HangboZhu opened this issue Nov 2, 2023 · 2 comments

Comments

@HangboZhu
Copy link

Dear Cao Bin:
Glad to see your TrAdaboost project on github, I'm very interested in it!
However, due to my shallow knowledge. I have a little bit of trouble understanding on which pre-trained model the regression model you constructed is based on for transfer learning.Can you use TrAdaBoost_R2 as an example and give me an idea of which pre-trained model he is finetuning on top of?
I hope you take time out of your busy schedule to give me an answer, I would appreciate it!
Best regards
Hangbo Zhu

@Bin-Cao
Copy link
Owner

Bin-Cao commented Nov 2, 2023

Thank you for referencing my open-source project. I would like to clarify that TrAdaboost is an instance transfer strategy proposed by Prof. Yang many years ago, which does not follow the pre-training and fine-tune strategy. The main focus of TrAdaboost is to identify the appropriate weights for the source domain training data in order to reduce the distribution distance between the source and target domains. If you are interested in the pre-training and fine-tune strategy, I recommend looking into parameter-based transfer learning.

@HangboZhu
Copy link
Author

Thank you for your reply and good luck with your research!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants