Predicting episodic memory formation for movie events

• Published in: Scientific reports Vol. 6; no. 1; p. 30175
• Main Authors: Tang, Hanlin, Singer, Jed, Ison, Matias J., Pivazyan, Gnel, Romaine, Melissa, Frias, Rosa, Meller, Elizabeth, Boulin, Adrianna, Carroll, James, Perron, Victoria, Dowcett, Sarah, Arellano, Marlise, Kreiman, Gabriel
• Format: Journal Article
• Language: English
• Published: London Nature Publishing Group UK 30.09.2016; Nature Publishing Group
• Subjects: 631/378/1595/2167; 631/477/2811; Animal memory; Computer applications; Dreams; Emotions; Humanities and Social Sciences; Learning algorithms; Long term memory; multidisciplinary; Science; Sensory integration; Visual stimuli
• ISSN: 2045-2322; 2045-2322
• DOI: 10.1038/srep30175

Episodic memories are long lasting and full of detail, yet imperfect and malleable. We quantitatively evaluated recollection of short audiovisual segments from movies as a proxy to real-life memory formation in 161 subjects at 15 minutes up to a year after encoding. Memories were reproducible within and across individuals, showed the typical decay with time elapsed between encoding and testing, were fallible yet accurate, and were insensitive to low-level stimulus manipulations but sensitive to high-level stimulus properties. Remarkably, memorability was also high for single movie frames, even one year post-encoding. To evaluate what determines the efficacy of long-term memory formation, we developed an extensive set of content annotations that included actions, emotional valence, visual cues and auditory cues. These annotations enabled us to document the content properties that showed a stronger correlation with recognition memory and to build a machine-learning computational model that accounted for episodic memory formation in single events for group averages and individual subjects with an accuracy of up to 80%. These results provide initial steps towards the development of a quantitative computational theory capable of explaining the subjective filtering steps that lead to how humans learn and consolidate memories.