Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[WIP][Feature] DPO #434

Open
wants to merge 19 commits into
base: main
Choose a base branch
from
Open

[WIP][Feature] DPO #434

wants to merge 19 commits into from

Commits on Feb 25, 2024

  1. init dpo file

    @amulil
    amulil committed Feb 25, 2024
    Configuration menu
    Copy the full SHA
    d1ca875 View commit details
    Browse the repository at this point in the history

Commits on Mar 6, 2024

  1. test dpo

    @amulil
    amulil committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    67c9251 View commit details
    Browse the repository at this point in the history

Commits on Mar 7, 2024

  1. [WIP] len_chosen不能为0

    @xiaohangguo
    xiaohangguo committed Mar 7, 2024
    Configuration menu
    Copy the full SHA
    e0e4f54 View commit details
    Browse the repository at this point in the history

  2. xx

    @xiaohangguo
    xiaohangguo committed Mar 7, 2024
    Configuration menu
    Copy the full SHA
    ec18b27 View commit details
    Browse the repository at this point in the history

Commits on Mar 9, 2024

  1. update how to get the length of chosen answer

    @amulil
    amulil committed Mar 9, 2024
    Configuration menu
    Copy the full SHA
    cc2fbe3 View commit details
    Browse the repository at this point in the history

  2. [WIP] test dpo __getitem__

    @xiaohangguo
    xiaohangguo committed Mar 9, 2024
    Configuration menu
    Copy the full SHA
    df99211 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into dpo

    @xiaohangguo
    xiaohangguo committed Mar 9, 2024
    Configuration menu
    Copy the full SHA
    548cf79 View commit details
    Browse the repository at this point in the history

  4. xx

    @xiaohangguo
    xiaohangguo committed Mar 9, 2024
    Configuration menu
    Copy the full SHA
    d121ca8 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'dpo' of https://github.com/amulil/xtuner into dpo

    @xiaohangguo
    xiaohangguo committed Mar 9, 2024
    Configuration menu
    Copy the full SHA
    5eb65dd View commit details
    Browse the repository at this point in the history

Commits on Mar 12, 2024

  1. update dpo

    @amulil
    amulil committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    ca8881f View commit details
    Browse the repository at this point in the history

Commits on Mar 16, 2024

  1. update dpo

    @amulil
    amulil committed Mar 16, 2024
    Configuration menu
    Copy the full SHA
    90c8d20 View commit details
    Browse the repository at this point in the history

Commits on Apr 1, 2024

  1. fix loss nan problem

    @amulil
    amulil committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    3fbdb60 View commit details
    Browse the repository at this point in the history

Commits on Apr 2, 2024

  1. add full dpo config

    @amulil
    amulil committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    46e24be View commit details
    Browse the repository at this point in the history

Commits on Apr 9, 2024

  1. support dpo with qlora

    @amulil
    amulil committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    aefd1de View commit details
    Browse the repository at this point in the history

Commits on Apr 13, 2024

  1. add dpo loss type

    @amulil
    amulil committed Apr 13, 2024
    Configuration menu
    Copy the full SHA
    8797fbc View commit details
    Browse the repository at this point in the history

Commits on May 16, 2024

  1. fix conflicts

    @hhaAndroid
    hhaAndroid committed May 16, 2024
    Configuration menu
    Copy the full SHA
    b2ef99b View commit details
    Browse the repository at this point in the history

  2. update

    @hhaAndroid
    hhaAndroid committed May 16, 2024
    Configuration menu
    Copy the full SHA
    231000f View commit details
    Browse the repository at this point in the history

Commits on May 27, 2024

  1. update

    @hhaAndroid
    hhaAndroid committed May 27, 2024
    Configuration menu
    Copy the full SHA
    26e878a View commit details
    Browse the repository at this point in the history

Commits on May 30, 2024

  1. update

    @amulil
    amulil committed May 30, 2024
    Configuration menu
    Copy the full SHA
    15e337f View commit details
    Browse the repository at this point in the history