Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

- Adding support for the "Schedule-free" method to be used as a wrapper for Optax optimizers in the examples codebase. #268

Merged
merged 1 commit into from
Sep 17, 2024
Merged

- Adding support for the "Schedule-free" method to be used as a wrapper for Optax optimizers in the examples codebase. #268

merged 1 commit into from
Sep 17, 2024
+225 −84

Commits on Sep 17, 2024

  1. - Adding support for the "Schedule-free" method to be used as a wrapp… 

    …er for Optax optimizers in the examples codebase.

- Slight reimplementation of WeightedMovingAverage. Should be a no-op up to numerics.

- Adding refresh_func_state_for_eval_with_n_iters to examples codebase to support better handling of BN stats when using Polyak averaging or Schedule-free.

PiperOrigin-RevId: 675596903
    @james-martens
    james-martens authored and KfacJaxDev committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    baaec40 View commit details
    Browse the repository at this point in the history