The Algonauts Project 2021 Challenge: How the Human Brain Makes Sense of a World in Motion

• Main Authors: Cichy, R. M, Dwivedi, K, Lahner, B, Lascelles, A, Iamshchinina, P, Graumann, M, Andonian, A, Murty, N. A. R, Kay, K, Roig, G, Oliva, A
• Format: Journal Article
• Language: English
• Published: 28.04.2021
• Subjects: Computer Science - Computer Vision and Pattern Recognition; Quantitative Biology - Neurons and Cognition
• DOI: 10.48550/arxiv.2104.13714

The sciences of natural and artificial intelligence are fundamentally connected. Brain-inspired human-engineered AI are now the standard for predicting human brain responses during vision, and conversely, the brain continues to inspire invention in AI. To promote even deeper connections between these fields, we here release the 2021 edition of the Algonauts Project Challenge: How the Human Brain Makes Sense of a World in Motion (http://algonauts.csail.mit.edu/). We provide whole-brain fMRI responses recorded while 10 human participants viewed a rich set of over 1,000 short video clips depicting everyday events. The goal of the challenge is to accurately predict brain responses to these video clips. The format of our challenge ensures rapid development, makes results directly comparable and transparent, and is open to all. In this way it facilitates interdisciplinary collaboration towards a common goal of understanding visual intelligence. The 2021 Algonauts Project is conducted in collaboration with the Cognitive Computational Neuroscience (CCN) conference.