initialization

Weight initialization: why neural networks start with carefully scaled randomness Lesson

Weight initialization gives a neural network its starting parameters, using carefully scaled randomness to break symmetry and keep signals and gradients usable before learning begins.