New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

add dpop training #5339

Open

threestone965 wants to merge 2 commits into hiyouga:main from threestone965:dpop-featrue

threestone965 commented Sep 3, 2024 •

edited

Loading

What does this PR do?

 新增dpop的训练代码，重写了self.dpo_loss方法（只是新增了计算惩罚项）

Before submitting

Did you read the contributor guideline?
Did you write any new necessary tests?


          add dpop training

9ca64f0

Author

threestone965 commented Sep 3, 2024

官方代码实现链接
abacusai/smaug#2 (comment)

hiyouga added the pending label


          del useless code

79b181b

hiyouga force-pushed the main branch from 5569125 to b4c7dd3 Compare

October 29, 2024 07:32

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

pending