MemGEN: Memory is All You Need

We propose a new learning paradigm called Deep Memory. It has the potential to completely revolutionize the Machine Learning field. Surprisingly, this paradigm has not been reinvented yet, unlike Deep Learning. At the core of this approach is the \textit{Learning By Heart} principle, well studied in...

Full description

Saved in:
Bibliographic Details
Published inarXiv.org
Main Authors Gelly, Sylvain, Kurach, Karol, Michalski, Marcin, Zhai, Xiaohua
Format Paper
LanguageEnglish
Published Ithaca Cornell University Library, arXiv.org 29.03.2018
Subjects
Algorithms
Decimals
Human behavior
Machine learning
Statistical methods
Statistical tests
Online AccessGet full text

Cover

More Information
Summary:We propose a new learning paradigm called Deep Memory. It has the potential to completely revolutionize the Machine Learning field. Surprisingly, this paradigm has not been reinvented yet, unlike Deep Learning. At the core of this approach is the \textit{Learning By Heart} principle, well studied in primary schools all over the world. Inspired by poem recitation, or by \(\pi\) decimal memorization, we propose a concrete algorithm that mimics human behavior. We implement this paradigm on the task of generative modeling, and apply to images, natural language and even the \(\pi\) decimals as long as one can print them as text. The proposed algorithm even generated this paper, in a one-shot learning setting. In carefully designed experiments, we show that the generated samples are indistinguishable from the training examples, as measured by any statistical tests or metrics.
ISSN:2331-8422