Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Enable flag to not pass PAD tokens in ffwd #775

Merged
merged 21 commits into from
Dec 11, 2023
Merged

Enable flag to not pass PAD tokens in ffwd #775

merged 21 commits into from
Dec 11, 2023

Commits on Dec 4, 2023

  1. Changing how attention_mask is being passed around

    @bcui19
    bcui19 committed Dec 4, 2023
    Configuration menu
    Copy the full SHA
    1f58bdd View commit details
    Browse the repository at this point in the history

  2. adding in option to toggle flags for padding

    @bcui19
    bcui19 committed Dec 4, 2023
    Configuration menu
    Copy the full SHA
    31e16ad View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into mask_pad_token

    @bcui19
    bcui19 committed Dec 4, 2023
    Configuration menu
    Copy the full SHA
    7256047 View commit details
    Browse the repository at this point in the history

Commits on Dec 5, 2023

  1. moving to flash attn import

    @bcui19
    bcui19 committed Dec 5, 2023
    Configuration menu
    Copy the full SHA
    2eeb51f View commit details
    Browse the repository at this point in the history

  2. merge

    @bcui19
    bcui19 committed Dec 5, 2023
    Configuration menu
    Copy the full SHA
    80cd4e5 View commit details
    Browse the repository at this point in the history

  3. removing unused import

    @bcui19
    bcui19 committed Dec 5, 2023
    Configuration menu
    Copy the full SHA
    ccba914 View commit details
    Browse the repository at this point in the history

  4. Removing excess stuff from pyproject

    @bcui19
    bcui19 committed Dec 5, 2023
    Configuration menu
    Copy the full SHA
    b4f59c0 View commit details
    Browse the repository at this point in the history

Commits on Dec 7, 2023

  1. refactor

    @bcui19
    bcui19 committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    e7160c0 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into mask_pad_token

    @bcui19
    bcui19 committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    ee0b07a View commit details
    Browse the repository at this point in the history

  3. Update llmfoundry/models/layers/blocks.py 

    Co-authored-by: Mihir Patel <[email protected]>
    @bcui19 @mvpatel2000
    bcui19 and mvpatel2000 committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    da6776a View commit details
    Browse the repository at this point in the history

  4. Update llmfoundry/models/layers/blocks.py 

    Co-authored-by: Mihir Patel <[email protected]>
    @bcui19 @mvpatel2000
    bcui19 and mvpatel2000 committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    f88bcfe View commit details
    Browse the repository at this point in the history

Commits on Dec 11, 2023

  1. Changing some naming conventions, moving where tests are done, adding… 

    … numerics test
    @bcui19
    bcui19 committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    6143f3f View commit details
    Browse the repository at this point in the history

  2. Updating import

    @bcui19
    bcui19 committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    6a40052 View commit details
    Browse the repository at this point in the history

  3. trying to fix tests

    @bcui19
    bcui19 committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    b5344c5 View commit details
    Browse the repository at this point in the history

  4. trying to fix tests

    @bcui19
    bcui19 committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    509309b View commit details
    Browse the repository at this point in the history

  5. Merge branch 'main' into mask_pad_token

    @bcui19
    bcui19 committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    70077ef View commit details
    Browse the repository at this point in the history

  6. updating tests

    @bcui19
    bcui19 committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    30217ef View commit details
    Browse the repository at this point in the history

  7. merge

    @bcui19
    bcui19 committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    3de2418 View commit details
    Browse the repository at this point in the history

  8. updating tests

    @bcui19
    bcui19 committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    205406e View commit details
    Browse the repository at this point in the history

  9. Update llmfoundry/models/mpt/configuration_mpt.py 

    Co-authored-by: Daniel King <[email protected]>
    @bcui19 @dakinggg
    bcui19 and dakinggg committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    74f99c3 View commit details
    Browse the repository at this point in the history

  10. Changing gating in tests to check for flash attn

    @bcui19
    bcui19 committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    d041023 View commit details
    Browse the repository at this point in the history