emergence
Everything on Ground Truth tagged “emergence” — 2 items.
Emergent abilities: do models suddenly gain skills, or are we measuring badly? Lesson
Emergent abilities are skills that appear absent in smaller models and present in larger ones, seeming to switch on abruptly rather than improve gradually. A influential 2023 rebuttal argued the sharpness is largely an artifact of all-or-nothing scoring, and the honest answer is that both sides are partly right.
In-context learning Lesson
In-context learning is a language model's ability to pick up a new task from examples placed in its prompt, without any change to its weights, and it is the reason prompting works at all.