Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bugs] Fix attn mask #852

Merged
merged 5 commits into from
Jul 19, 2024
Merged

[Bugs] Fix attn mask #852

merged 5 commits into from
Jul 19, 2024

Commits on Jul 11, 2024

  1. [WIP]: Fix sequence parallel memory bottleneck in DPO

    @RangiLyu
    RangiLyu committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    ce9bb62 View commit details
    Browse the repository at this point in the history

  2. loss mask before split

    @RangiLyu
    RangiLyu committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    8753d9a View commit details
    Browse the repository at this point in the history

Commits on Jul 12, 2024

  1. refactor orpo

    @RangiLyu
    RangiLyu committed Jul 12, 2024
    Configuration menu
    Copy the full SHA
    1f58ee7 View commit details
    Browse the repository at this point in the history

Commits on Jul 19, 2024

  1. fix attention_mask in preference_collate_fn

    @HIT-cwh
    HIT-cwh committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    03712bf View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into fix_attn_mask

    @HIT-cwh
    HIT-cwh committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    f3813ba View commit details
    Browse the repository at this point in the history