Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add epochs to levanter #768

Open
wants to merge 22 commits into
base: main
Choose a base branch
from
Open

Add epochs to levanter #768

wants to merge 22 commits into from

Commits on Oct 16, 2024

  1. wip epochs

    @ahmeda14960
    ahmeda14960 committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    234a945 View commit details
    Browse the repository at this point in the history

  2. fix

    @ahmeda14960
    ahmeda14960 committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    f0b1eaa View commit details
    Browse the repository at this point in the history

  3. add epoch flag, sanity check tulu one epoch

    @ahmeda14960
    ahmeda14960 committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    020a1b2 View commit details
    Browse the repository at this point in the history

  4. epochs work

    @ahmeda14960
    ahmeda14960 committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    50500b9 View commit details
    Browse the repository at this point in the history

  5. minor fix

    @ahmeda14960
    ahmeda14960 committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    49afb5d View commit details
    Browse the repository at this point in the history

  6. fix ci

    @ahmeda14960
    ahmeda14960 committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    c2ed3ee View commit details
    Browse the repository at this point in the history

  7. fix ci

    @ahmeda14960
    ahmeda14960 committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    667a5a3 View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2024

  1. fix config file

    @ahmeda14960
    ahmeda14960 committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    37e77fb View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2024

  1. add suggested fix from david

    @ahmeda14960
    ahmeda14960 committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    7c195ba View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2024

  1. Merge remote-tracking branch 'origin/main' into sft

    @ahmeda14960
    ahmeda14960 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    e71ed16 View commit details
    Browse the repository at this point in the history

  2. restore toml

    @ahmeda14960
    ahmeda14960 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    54a6007 View commit details
    Browse the repository at this point in the history

  3. Update src/levanter/callbacks.py 

    Co-authored-by: David Hall <[email protected]>
    @ahmeda14960 @dlwh
    ahmeda14960 and dlwh authored Oct 23, 2024
    Configuration menu
    Copy the full SHA
    e2646d6 View commit details
    Browse the repository at this point in the history

  4. refactor

    @ahmeda14960
    ahmeda14960 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    fd18cae View commit details
    Browse the repository at this point in the history

  5. add suggested fix from david

    @ahmeda14960
    ahmeda14960 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    1706803 View commit details
    Browse the repository at this point in the history

  6. update for v4 so we don't crash

    @ahmeda14960
    ahmeda14960 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    f0ca163 View commit details
    Browse the repository at this point in the history

  7. remove changes that break epochs

    @ahmeda14960
    ahmeda14960 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    c971ebf View commit details
    Browse the repository at this point in the history

  8. final fixes

    @ahmeda14960
    ahmeda14960 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    4733f3b View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2024

  1. final fixes

    @ahmeda14960
    ahmeda14960 committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    e82eec2 View commit details
    Browse the repository at this point in the history

  2. substatial changes to save on epochs w callback

    @ahmeda14960
    ahmeda14960 committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    08fd427 View commit details
    Browse the repository at this point in the history

  3. epoch tracking still broken

    @ahmeda14960
    ahmeda14960 committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    18a5352 View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2024

  1. Merge remote-tracking branch 'origin/main' into sft

    @ahmeda14960
    ahmeda14960 committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    f1ef2c7 View commit details
    Browse the repository at this point in the history

  2. WIP

    @ahmeda14960
    ahmeda14960 committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    c38b076 View commit details
    Browse the repository at this point in the history