Open
Description
Will the mmbench test set score drop after dpo? Does this repo supports dpo without another reward model loaded?
Metadata
Metadata
Assignees
Labels
No labels
{{ message }}
No one assigned
No labels
No type
No projects
No milestone
None yet
No branches or pull requests