kl-divergence

DistillAlign explains why fast video models get prettier and more repetitive at the same time News

A new preprint shows that the standard technique for speeding up video generators optimises a mathematical objective that deliberately concentrates on safe, common outputs, and that adding a diversity-preserving loss back during that stage more than doubled the paper's coverage measure without giving up the quality gain.