Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Adds ATen fallback for scaled_dot_product_attention #21107

Merged
merged 35 commits into from
Jul 22, 2024
Merged

Adds ATen fallback for scaled_dot_product_attention #21107

merged 35 commits into from
Jul 22, 2024

Commits on Jun 19, 2024

  1. attn aten fallback

    root committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    f22b8dc View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2024

  1. use correct operator names

    root committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    612e425 View commit details
    Browse the repository at this point in the history

  2. formatting

    root committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    bdcfebb View commit details
    Browse the repository at this point in the history

  3. add unit test

    root committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    80c3107 View commit details
    Browse the repository at this point in the history

  4. formatting

    root committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    2b29b4c View commit details
    Browse the repository at this point in the history

Commits on Jun 26, 2024

  1. use pytorch sdpa kernel

    root committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    d2b8566 View commit details
    Browse the repository at this point in the history

  2. bug fix

    root committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    0ca8fa0 View commit details
    Browse the repository at this point in the history

  3. lint

    root committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    8999ff2 View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2024

  1. use different kernel

    root committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    6bf3018 View commit details
    Browse the repository at this point in the history

  2. formatting

    root committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    35bd07a View commit details
    Browse the repository at this point in the history

Commits on Jul 2, 2024

  1. include Peng's & Vincent's editS

    root committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    dd1849a View commit details
    Browse the repository at this point in the history

  2. adjust test and comments

    @prathikr
    prathikr committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    8219ec9 View commit details
    Browse the repository at this point in the history

  3. move import inside test

    @prathikr
    prathikr committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    65c2cb7 View commit details
    Browse the repository at this point in the history

  4. merge with master

    @prathikr
    prathikr committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    b5f5863 View commit details
    Browse the repository at this point in the history

  5. feature flag

    @prathikr
    prathikr committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    18648ad View commit details
    Browse the repository at this point in the history

  6. add documentation

    @prathikr
    prathikr committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    be9ce0a View commit details
    Browse the repository at this point in the history

  7. minor fixes

    @prathikr
    prathikr committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    e269e89 View commit details
    Browse the repository at this point in the history

  8. doc update

    @prathikr
    prathikr committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    d3cc487 View commit details
    Browse the repository at this point in the history

Commits on Jul 8, 2024

  1. peng fix, xavier suggestion

    @prathikr
    prathikr committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    f500528 View commit details
    Browse the repository at this point in the history

  2. bug fix

    @prathikr
    prathikr committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    c4cdab6 View commit details
    Browse the repository at this point in the history

  3. bug fix

    @prathikr
    prathikr committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    c05a5ee View commit details
    Browse the repository at this point in the history

  4. bug fix

    @prathikr
    prathikr committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    f82bd48 View commit details
    Browse the repository at this point in the history

  5. adjust unit test

    @prathikr
    prathikr committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    668409b View commit details
    Browse the repository at this point in the history

Commits on Jul 9, 2024

  1. adjust checks

    @prathikr
    prathikr committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    b5f1169 View commit details
    Browse the repository at this point in the history

  2. grad input fix

    @prathikr
    prathikr committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    31becab View commit details
    Browse the repository at this point in the history

  3. handle both with and without bias

    @prathikr
    prathikr committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    5aa147d View commit details
    Browse the repository at this point in the history

  4. full mask

    @prathikr
    prathikr committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    37eb6bc View commit details
    Browse the repository at this point in the history

Commits on Jul 12, 2024

  1. merge with main

    @prathikr
    prathikr committed Jul 12, 2024
    Configuration menu
    Copy the full SHA
    ae3b5e7 View commit details
    Browse the repository at this point in the history

  2. lint

    @prathikr
    prathikr committed Jul 12, 2024
    Configuration menu
    Copy the full SHA
    3484926 View commit details
    Browse the repository at this point in the history

Commits on Jul 15, 2024

  1. add version check for tesT

    @prathikr
    prathikr committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    8d0e879 View commit details
    Browse the repository at this point in the history

Commits on Jul 16, 2024

  1. grad output adjustment

    @prathikr
    prathikr committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    b72a042 View commit details
    Browse the repository at this point in the history

  2. add more docs

    @prathikr
    prathikr committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    6b4dd10 View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2024

  1. remove support for masked attention

    @prathikr
    prathikr committed Jul 17, 2024
    Configuration menu
    Copy the full SHA
    999b04b View commit details
    Browse the repository at this point in the history

Commits on Jul 18, 2024

  1. adjust docs

    @prathikr
    prathikr committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    b1fe489 View commit details
    Browse the repository at this point in the history

Commits on Jul 22, 2024

  1. Merge remote-tracking branch 'origin' into prathikrao/attn-aten-fallback

    @prathikr
    prathikr committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    4ab54e6 View commit details
    Browse the repository at this point in the history