Statistical Inference With Limited Memory: A Survey

• Published in: IEEE journal on selected areas in information theory Vol. 5; pp. 623 - 644
• Main Authors: Berg, Tomer, Ordentlich, Or, Shayevitz, Ofer
• Format: Journal Article
• Language: English
• Published: IEEE 2024
• Subjects: communication complexity; entropy estimation; Error probability; Estimation; finite memory algorithms; Inference algorithms; inference under memory constraints; Information theory; Memory complexity; Memory management; Parameter estimation; sample complexity; simple hypothesis testing; Surveys; Testing; uniformity testing

The problem of statistical inference in its various forms has been the subject of decades-long extensive research. Most of the effort has been focused on characterizing the behavior as a function of the number of available samples, with far less attention given to the effect of memory limitations on...