model-merging

Model merging: combining two fine-tuned models by averaging their weights Lesson

Model merging combines two or more models that share a common ancestor by arithmetic on their weights - averaging them, adding their differences, or interpolating between them - producing a single model with both sets of skills and no additional training.