This paper introduces various methods for matching and interpolating the weights of multiple neural networks of the same architecture trained from different starting points or data. These neural networks have different weight values after the training.
- Samuel K. Ainsworth, Jonathan Hayase, Siddhartha Srinivasa. . "Git Re-basin: Merging Models Modulo Permutation Symmetries". arXiv. DOI.