Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature] Pipeline Parallelization of Different Stages in RLHF #877

Open
wants to merge 19 commits into
base: main
Choose a base branch
from
Open

[Feature] Pipeline Parallelization of Different Stages in RLHF #877

wants to merge 19 commits into from

Commits on Jun 25, 2024

  1. add rlhf

    zhaohui committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    0e1453a View commit details
    Browse the repository at this point in the history

  2. add/fix pretrain_loss

    @ShuaibinLi
    ShuaibinLi authored and zhaohui committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    14ea454 View commit details
    Browse the repository at this point in the history

  3. dataloader, resolve comments

    @ShuaibinLi
    ShuaibinLi authored and zhaohui committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    72ede3b View commit details
    Browse the repository at this point in the history

  4. rename,remove

    @ShuaibinLi
    ShuaibinLi authored and zhaohui committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    6adc32c View commit details
    Browse the repository at this point in the history

  5. save tokenizer

    @ShuaibinLi
    ShuaibinLi authored and zhaohui committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    9599838 View commit details
    Browse the repository at this point in the history

  6. rm/move models

    @ShuaibinLi
    ShuaibinLi authored and zhaohui committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    bb96eef View commit details
    Browse the repository at this point in the history

  7. fix: zero3 for bigger models

    @kiddie92
    kiddie92 authored and zhaohui committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    5d6fb35 View commit details
    Browse the repository at this point in the history

  8. precommit check

    @kiddie92
    kiddie92 authored and zhaohui committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    795995d View commit details
    Browse the repository at this point in the history

  9. resume

    @ShuaibinLi
    ShuaibinLi authored and zhaohui committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    1ff6ab3 View commit details
    Browse the repository at this point in the history

  10. fix resume/pretrain_data

    @ShuaibinLi
    ShuaibinLi authored and zhaohui committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    e1c8c61 View commit details
    Browse the repository at this point in the history

  11. fix tokenizer bug

    @ShuaibinLi
    ShuaibinLi authored and zhaohui committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    89bfe9d View commit details
    Browse the repository at this point in the history

  12. async learn

    @qzweng
    qzweng authored and qzweng committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    82a3366 View commit details
    Browse the repository at this point in the history

  13. add and rename ppo configs

    @qzweng
    qzweng authored and qzweng committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    6531b5d View commit details
    Browse the repository at this point in the history

Commits on Jun 26, 2024

  1. fix rm/sys promt

    @ShuaibinLi
    ShuaibinLi committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    7f7bab8 View commit details
    Browse the repository at this point in the history

  2. fix vllm dp size>1

    @kiddie92
    kiddie92 committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    ea9c67f View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2024

  1. fix/add data_map_fn

    @ShuaibinLi
    ShuaibinLi committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    7d6e1b3 View commit details
    Browse the repository at this point in the history

  2. fix: vllm dp&tp size

    @kiddie92
    kiddie92 committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    1a284ff View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2024

  1. optimize rlhf performance using pipeline

    @llkn-2
    llkn-2 committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    b35b719 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'rlhf-dev' into rlhf-pipe

    @llkn-2
    llkn-2 committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    9d977a0 View commit details
    Browse the repository at this point in the history