superalignment

Weak-to-Strong Generalization: how a worse teacher can train a better student Lesson

Weak-to-strong generalization is the finding that a strong model trained on a weaker model's flawed labels can substantially outperform its teacher, which is the only reason humans have any hope of supervising systems smarter than themselves.