Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Allow flash attention 2 and upgrade to transformers 4.34.1 #672

Merged
merged 30 commits into from
Oct 24, 2023
Merged

Allow flash attention 2 and upgrade to transformers 4.34.1 #672

merged 30 commits into from
Oct 24, 2023

Commits on Oct 13, 2023

  1. llama unit tests pass again

    @dakinggg
    dakinggg committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    6872b7e View commit details
    Browse the repository at this point in the history

  2. more special casing in tokenizer equivalence check

    @dakinggg
    dakinggg committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    d1efda1 View commit details
    Browse the repository at this point in the history

  3. move the patch to module init

    @dakinggg
    dakinggg committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    fdc89f0 View commit details
    Browse the repository at this point in the history

  4. fix addedtoken -> str

    @dakinggg
    dakinggg committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    633ddfc View commit details
    Browse the repository at this point in the history

  5. precommit

    @dakinggg
    dakinggg committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    7acace5 View commit details
    Browse the repository at this point in the history

Commits on Oct 14, 2023

  1. flash2 unit tests pass

    @dakinggg
    dakinggg committed Oct 14, 2023
    Configuration menu
    Copy the full SHA
    a0e709b View commit details
    Browse the repository at this point in the history

  2. precommit

    @dakinggg
    dakinggg committed Oct 14, 2023
    Configuration menu
    Copy the full SHA
    4d944b9 View commit details
    Browse the repository at this point in the history

  3. fix tests

    @dakinggg
    dakinggg committed Oct 14, 2023
    Configuration menu
    Copy the full SHA
    adac5c0 View commit details
    Browse the repository at this point in the history

  4. precommit

    @dakinggg
    dakinggg committed Oct 14, 2023
    Configuration menu
    Copy the full SHA
    6ae2393 View commit details
    Browse the repository at this point in the history

  5. fix test

    @dakinggg
    dakinggg committed Oct 14, 2023
    Configuration menu
    Copy the full SHA
    4b6dd78 View commit details
    Browse the repository at this point in the history

  6. try again

    @dakinggg
    dakinggg committed Oct 14, 2023
    Configuration menu
    Copy the full SHA
    4e7c628 View commit details
    Browse the repository at this point in the history

  7. add lazy load option

    @dakinggg
    dakinggg committed Oct 14, 2023
    Configuration menu
    Copy the full SHA
    c1d00e9 View commit details
    Browse the repository at this point in the history

  8. fix test

    @dakinggg
    dakinggg committed Oct 14, 2023
    Configuration menu
    Copy the full SHA
    0ea0d7d View commit details
    Browse the repository at this point in the history

  9. precommit

    @dakinggg
    dakinggg committed Oct 14, 2023
    Configuration menu
    Copy the full SHA
    242f7c9 View commit details
    Browse the repository at this point in the history

  10. add gc collect

    @dakinggg
    dakinggg committed Oct 14, 2023
    Configuration menu
    Copy the full SHA
    d002bd8 View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2023

  1. Merge branch 'main' into tr34-flash2

    @dakinggg
    dakinggg committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    e60eef1 View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2023

  1. Merge branch 'main' into tr34-flash2

    @dakinggg
    dakinggg committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    dedd4cd View commit details
    Browse the repository at this point in the history

Commits on Oct 22, 2023

  1. Merge branch 'main' into tr34-flash2

    @dakinggg
    dakinggg committed Oct 22, 2023
    Configuration menu
    Copy the full SHA
    bf6d947 View commit details
    Browse the repository at this point in the history

  2. updates for the patch release

    @dakinggg
    dakinggg committed Oct 22, 2023
    Configuration menu
    Copy the full SHA
    b7a0a96 View commit details
    Browse the repository at this point in the history

  3. precommit

    @dakinggg
    dakinggg committed Oct 22, 2023
    Configuration menu
    Copy the full SHA
    f519adb View commit details
    Browse the repository at this point in the history

  4. add documentation for flash attention options

    @dakinggg
    dakinggg committed Oct 22, 2023
    Configuration menu
    Copy the full SHA
    523a329 View commit details
    Browse the repository at this point in the history

  5. small fixes

    @dakinggg
    dakinggg committed Oct 22, 2023
    Configuration menu
    Copy the full SHA
    91ec66a View commit details
    Browse the repository at this point in the history

  6. remove default fa setting

    @dakinggg
    dakinggg committed Oct 22, 2023
    Configuration menu
    Copy the full SHA
    1604586 View commit details
    Browse the repository at this point in the history

  7. fix test

    @dakinggg
    dakinggg committed Oct 22, 2023
    Configuration menu
    Copy the full SHA
    834e46f View commit details
    Browse the repository at this point in the history

  8. fix again

    @dakinggg
    dakinggg committed Oct 22, 2023
    Configuration menu
    Copy the full SHA
    317cb1a View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2023

  1. Merge branch 'main' into tr34-flash2

    @dakinggg
    dakinggg committed Oct 23, 2023
    Configuration menu
    Copy the full SHA
    5ec9cea View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2023

  1. use patch

    @dakinggg
    dakinggg committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    6db6315 View commit details
    Browse the repository at this point in the history

  2. remove commented out code

    @dakinggg
    dakinggg committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    528340f View commit details
    Browse the repository at this point in the history

  3. lazy load comment

    @dakinggg
    dakinggg committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    aaa82b2 View commit details
    Browse the repository at this point in the history

  4. fix readme typo

    @dakinggg
    dakinggg committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    a544d4a View commit details
    Browse the repository at this point in the history