Learning to Recognize Actions From Limited Training Examples Using a Recurrent Spiking Neural Model
A fundamental challenge in machine learning today is to build a model that can learn from few examples. Here, we describe a reservoir based spiking neural model for learning to recognize actions with a limited number of labeled videos. First, we propose a novel encoding, inspired by how microsaccade...
Saved in:
Published in | Frontiers in neuroscience Vol. 12; p. 126 |
---|---|
Main Authors | , |
Format | Journal Article |
Language | English |
Published |
Switzerland
Frontiers Research Foundation
02.03.2018
Frontiers Media S.A |
Subjects | |
Online Access | Get full text |
Cover
Loading…
Summary: | A fundamental challenge in machine learning today is to build a model that can learn from few examples. Here, we describe a reservoir based spiking neural model for learning to recognize actions with a limited number of labeled videos. First, we propose a novel encoding, inspired by how microsaccades influence visual perception, to extract spike information from raw video data while preserving the temporal correlation across different frames. Using this encoding, we show that the reservoir generalizes its rich dynamical activity toward signature action/movements enabling it to learn from few training examples. We evaluate our approach on the UCF-101 dataset. Our experiments demonstrate that our proposed reservoir achieves 81.3/87% Top-1/Top-5 accuracy, respectively, on the 101-class data while requiring just 8 video examples per class for training. Our results establish a new benchmark for action recognition from limited video examples for spiking neural models while yielding competitive accuracy with respect to state-of-the-art non-spiking neural models. |
---|---|
Bibliography: | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 23 This article was submitted to Neuromorphic Engineering, a section of the journal Frontiers in Neuroscience Reviewed by: Subhrajit Roy, IBM Research, Australia; Chetan Singh Thakur, Indian Institute of Science, India; Yulia Sandamirskaya, University of Zurich, Switzerland Present Address: Narayan Srinivasa, Independent Researcher, Westlake Village, CA, United States Edited by: Arindam Basu, Nanyang Technological University, Singapore |
ISSN: | 1662-4548 1662-453X 1662-453X |
DOI: | 10.3389/fnins.2018.00126 |