Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add lola #11

Open
wants to merge 36 commits into
base: main
Choose a base branch
from
Open

Add lola #11

wants to merge 36 commits into from

Commits on Jun 27, 2022

  1. begin adding centralized learning

    @newtonkwan
    newtonkwan committed Jun 27, 2022
    Configuration menu
    Copy the full SHA
    2d5ed96 View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2022

  1. first commit. begin adding centralized training for LOLA

    @newtonkwan
    newtonkwan committed Jul 5, 2022
    Configuration menu
    Copy the full SHA
    ec3ce6a View commit details
    Browse the repository at this point in the history

  2. add base lola

    @newtonkwan
    newtonkwan committed Jul 5, 2022
    Configuration menu
    Copy the full SHA
    2664eea View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into add_lola

    @newtonkwan
    newtonkwan authored Jul 5, 2022
    Configuration menu
    Copy the full SHA
    461f772 View commit details
    Browse the repository at this point in the history

  4. add centralized learner

    @newtonkwan
    newtonkwan committed Jul 5, 2022
    Configuration menu
    Copy the full SHA
    bcb4833 View commit details
    Browse the repository at this point in the history

  5. resolve merge conflict. add centralized learning

    @newtonkwan
    newtonkwan committed Jul 5, 2022
    Configuration menu
    Copy the full SHA
    39de443 View commit details
    Browse the repository at this point in the history

  6. add lola machinery to experiments.py

    @newtonkwan
    newtonkwan committed Jul 5, 2022
    Configuration menu
    Copy the full SHA
    6c17d02 View commit details
    Browse the repository at this point in the history

Commits on Jul 6, 2022

  1. fix entropy annealing

    @newtonkwan
    newtonkwan committed Jul 6, 2022
    Configuration menu
    Copy the full SHA
    8fab167 View commit details
    Browse the repository at this point in the history

Commits on Jul 7, 2022

  1. fix done conditiion in additional rollout step in PPO

    @newtonkwan
    newtonkwan committed Jul 7, 2022
    Configuration menu
    Copy the full SHA
    21dc4fd View commit details
    Browse the repository at this point in the history

Commits on Jul 8, 2022

  1. minor changes to lola

    @newtonkwan
    newtonkwan committed Jul 8, 2022
    Configuration menu
    Copy the full SHA
    6fe1d02 View commit details
    Browse the repository at this point in the history

Commits on Jul 12, 2022

  1. merge main with add_lola

    @newtonkwan
    newtonkwan committed Jul 12, 2022
    Configuration menu
    Copy the full SHA
    ac3a7f1 View commit details
    Browse the repository at this point in the history

  2. minor bug fix

    @newtonkwan
    newtonkwan committed Jul 12, 2022
    Configuration menu
    Copy the full SHA
    b409692 View commit details
    Browse the repository at this point in the history

Commits on Jul 13, 2022

  1. add changes to buffer

    @newtonkwan
    newtonkwan committed Jul 13, 2022
    Configuration menu
    Copy the full SHA
    8f42170 View commit details
    Browse the repository at this point in the history

  2. merge recent main updates Merge branch 'main' into add_lola

    @newtonkwan
    newtonkwan committed Jul 13, 2022
    Configuration menu
    Copy the full SHA
    acc514a View commit details
    Browse the repository at this point in the history

Commits on Jul 15, 2022

  1. update confs

    @newtonkwan
    newtonkwan committed Jul 15, 2022
    Configuration menu
    Copy the full SHA
    fce83a4 View commit details
    Browse the repository at this point in the history

Commits on Jul 19, 2022

  1. add naive learner

    @newtonkwan
    newtonkwan committed Jul 19, 2022
    Configuration menu
    Copy the full SHA
    d1be0c5 View commit details
    Browse the repository at this point in the history

  2. pull changes from main

    @newtonkwan
    newtonkwan committed Jul 19, 2022
    Configuration menu
    Copy the full SHA
    dbe82c3 View commit details
    Browse the repository at this point in the history

Commits on Jul 22, 2022

  1. lazy commit. commiting to add naive learner PR

    @newtonkwan
    newtonkwan committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    a855c4b View commit details
    Browse the repository at this point in the history

  2. merge main

    @newtonkwan
    newtonkwan committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    f11dce8 View commit details
    Browse the repository at this point in the history

Commits on Jul 27, 2022

  1. add logic for lola (still debugging)

    @newtonkwan
    newtonkwan committed Jul 27, 2022
    Configuration menu
    Copy the full SHA
    bb7b03b View commit details
    Browse the repository at this point in the history

  2. add lola (doesn't quite work yet)

    @newtonkwan
    newtonkwan committed Jul 27, 2022
    Configuration menu
    Copy the full SHA
    c169c75 View commit details
    Browse the repository at this point in the history

Commits on Jul 28, 2022

  1. compiling lola...

    @newtonkwan
    newtonkwan committed Jul 28, 2022
    Configuration menu
    Copy the full SHA
    1a00280 View commit details
    Browse the repository at this point in the history

  2. working lola

    @newtonkwan
    newtonkwan committed Jul 28, 2022
    Configuration menu
    Copy the full SHA
    be33bc8 View commit details
    Browse the repository at this point in the history

  3. update configs

    @newtonkwan
    newtonkwan committed Jul 28, 2022
    Configuration menu
    Copy the full SHA
    3cedf4e View commit details
    Browse the repository at this point in the history

  4. tidy up

    @newtonkwan
    newtonkwan committed Jul 28, 2022
    Configuration menu
    Copy the full SHA
    b37aa91 View commit details
    Browse the repository at this point in the history

Commits on Jul 29, 2022

  1. pull in main

    @newtonkwan
    newtonkwan committed Jul 29, 2022
    Configuration menu
    Copy the full SHA
    a2eb9e2 View commit details
    Browse the repository at this point in the history

  2. add working lola with new runner using lax.scan

    @newtonkwan
    newtonkwan committed Jul 29, 2022
    Configuration menu
    Copy the full SHA
    99c7906 View commit details
    Browse the repository at this point in the history

Commits on Jul 30, 2022

  1. tidy up watchers, fix naive learner, LOLA getting exploited hard ....

    @newtonkwan
    newtonkwan committed Jul 30, 2022
    Configuration menu
    Copy the full SHA
    dbb3937 View commit details
    Browse the repository at this point in the history

  2. tidy up watchers, fix naive learner, LOLA getting exploited hard ....

    @newtonkwan
    newtonkwan committed Jul 30, 2022
    Configuration menu
    Copy the full SHA
    11b98c6 View commit details
    Browse the repository at this point in the history

Commits on Aug 1, 2022

  1. lola compiles, move TrainingState to utils

    @newtonkwan
    newtonkwan committed Aug 1, 2022
    Configuration menu
    Copy the full SHA
    aeb6426 View commit details
    Browse the repository at this point in the history

  2. lastest lola

    @newtonkwan
    newtonkwan committed Aug 1, 2022
    Configuration menu
    Copy the full SHA
    c9cd40c View commit details
    Browse the repository at this point in the history

  3. fix axis

    @newtonkwan
    newtonkwan committed Aug 1, 2022
    Configuration menu
    Copy the full SHA
    dd29be0 View commit details
    Browse the repository at this point in the history

  4. fix axis

    @newtonkwan
    newtonkwan committed Aug 1, 2022
    Configuration menu
    Copy the full SHA
    78c8196 View commit details
    Browse the repository at this point in the history

  5. similar lola

    @newtonkwan
    newtonkwan committed Aug 1, 2022
    Configuration menu
    Copy the full SHA
    c4b2e72 View commit details
    Browse the repository at this point in the history

  6. half working lola

    @newtonkwan
    newtonkwan committed Aug 1, 2022
    Configuration menu
    Copy the full SHA
    2f30284 View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2022

  1. temporary lola

    @newtonkwan
    newtonkwan committed Aug 2, 2022
    Configuration menu
    Copy the full SHA
    4ad1b76 View commit details
    Browse the repository at this point in the history