preference-learning
Everything on Ground Truth tagged “preference-learning” — 1 item.
Direct Preference Optimization: skipping the reward model entirely Lesson
Direct Preference Optimization trains a language model on human preference pairs without ever building a separate reward model or running reinforcement learning, by showing mathematically that the model can serve as its own reward function.