Git Re-Basin: Merging Models modulo Permutation Symmetries by Ainsworth, S. K., Hayase, J., & Srinivasa, S. (2022)

source
(Ainsworth et al. 2022)
tags
Neural networks

Summary

This paper introduces various methods for matching and interpolating the weights of multiple neural networks of the same architecture trained from different starting points or data.

Comments

Bibliography

  1. . . "Git Re-basin: Merging Models Modulo Permutation Symmetries". arXiv. DOI.
Last changed | authored by

Comments


← Back to Notes