Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add Swin model #394

Merged
merged 15 commits into from
Sep 3, 2024
Merged

Add Swin model #394

merged 15 commits into from
Sep 3, 2024

Commits on Aug 16, 2024

  1. Added Swin model

    @bosko
    bosko committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    772fdd3 View commit details
    Browse the repository at this point in the history

  2. feat: windows partitioning and calculating attention mask

    @bosko
    bosko committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    a0dd299 View commit details
    Browse the repository at this point in the history

  3. feat: completed all layers but still not functional

    @bosko
    bosko committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    eee7a46 View commit details
    Browse the repository at this point in the history

  4. fix: attention mask is expected to be boolean mask

    @bosko
    bosko committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    a0326f3 View commit details
    Browse the repository at this point in the history

  5. feat: splitting layers as suggested by Jonatan (still not able to loa… 

    …d model)
    @bosko
    bosko committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    132bc60 View commit details
    Browse the repository at this point in the history

  6. fix: attention results handling, roll function call and dense calcula… 

    …tion
    @bosko
    bosko committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    6ba22ae View commit details
    Browse the repository at this point in the history

  7. feat: added all layers for each block

    @bosko
    bosko committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    3c8e8b3 View commit details
    Browse the repository at this point in the history

  8. feat: pad if needed and implemented relative position index function

    @bosko
    bosko committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    ed36ec0 View commit details
    Browse the repository at this point in the history

  9. feat: we are calculating attention due to Swin specifics

    @bosko
    bosko committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    2666d6c View commit details
    Browse the repository at this point in the history

  10. feat: removed Bumblebee attention usage

    @bosko
    bosko committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    87e9f92 View commit details
    Browse the repository at this point in the history

Commits on Aug 19, 2024

  1. fix: calculating layer output

    @bosko
    bosko committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    42a5a64 View commit details
    Browse the repository at this point in the history

  2. feat: added Swin test 

    Swin returns 1000 probabilities ann test takes into account only first
10 values.
    @bosko
    bosko committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    5984318 View commit details
    Browse the repository at this point in the history

Commits on Aug 23, 2024

  1. Add tests

    @jonatanklosko
    jonatanklosko committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    12de8ad View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2024

  1. Fixes and refactor

    @jonatanklosko
    jonatanklosko committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    740a345 View commit details
    Browse the repository at this point in the history

  2. Up

    @jonatanklosko
    jonatanklosko committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    1b3c5a0 View commit details
    Browse the repository at this point in the history