Scaling down Deep Learning by Greydanus, S. (2020)

tags
Neural networks
source
(Greydanus 2020)

Summary

This paper introduces a minimalist 1D version of the MNIST dataset for studying some basic properties of neural networks. The authors simplify the MNIST dataset by assigning a 1D glyph to each digit. These glyphs are padded, translated, sheared and blurred to build a dataset of multiple different objects.

The figure from the paper shown below illustrates this dataset’s construction:

This dataset is shown to be a suitable tool to study very small neural networks and their properties. The authors discuss: