Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How can I use other optimizers in LISA? #893

Open
greatzane opened this issue Aug 22, 2024 · 1 comment
Open

How can I use other optimizers in LISA? #893

greatzane opened this issue Aug 22, 2024 · 1 comment

Comments

@greatzane
Copy link

I tried to pass --optim , nothing happens. How can I use optimizers such as adamw_8bit or adafactor in LISA?
They are not in the custom_optimizers either.

@research4pan
Copy link
Contributor

Thanks for your interest in LMFlow! Normally LISA should effect all optimizers. We are wondering if you could provide the screenshot of the problem so we could check that for you? Thanks very much for providing the suggestion 😄

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants