probability
Everything on Ground Truth tagged “probability” — 2 items.
Bayesian updating: how a belief should change when evidence arrives Lesson
Bayesian updating is the rule for revising a belief when new evidence comes in: start with a prior, weigh how much more likely the evidence is under one hypothesis than another, and get a posterior.
Forward and Reverse KL Divergence Lesson
KL divergence measures how far one probability distribution is from another, and it is asymmetric: swapping which distribution goes first changes whether your model tries to cover everything the target does or commit to one part of it.