loss-functions
Everything on Ground Truth tagged “loss-functions” — 2 items.
Forward and Reverse KL Divergence Lesson
KL divergence measures how far one probability distribution is from another, and it is asymmetric: swapping which distribution goes first changes whether your model tries to cover everything the target does or commit to one part of it.
Softmax and Cross-Entropy: How a Model Turns Scores Into a Confident Guess Lesson
Softmax turns a model's raw scores into a probability distribution, and cross-entropy measures how far that distribution is from the true answer; together they are the training target behind almost every classifier and language model.