Hopfield Networks is All You Need by Ramsauer, H., Schäfl, B., Lehner, J., Seidl, P., Widrich, M., Gruber, L., Holzleitner, M., … (2020)

tags

Hopfield Networks, Attention

source

(Ramsauer et al. 2020)

resources

Blog post

Summary

This quote summarizes the paper well: “In order to integrate modern Hopfield networks into deep learning architectures, we have to make them continuous”.

Comments

Bibliography

1. Hubert Ramsauer, Bernhard Schäfl, Johannes Lehner, Philipp Seidl, Michael Widrich, Lukas Gruber, Markus Holzleitner, et al.. July 16, 2020. "Hopfield Networks Is All You Need". Arxiv:2008.02217 [cs, Stat]. http://arxiv.org/abs/2008.02217.