Real-time neuro-inspired sound source localization and tracking architecture applied to a robotic platform

• Published in: Neurocomputing (Amsterdam) Vol. 283; pp. 129 - 139
• Main Authors: Escudero, Elena Cerezuela, Peña, Fernando Pérez, Vicente, Rafael Paz, Jimenez-Fernandez, Angel, Moreno, Gabriel Jimenez, Morgado-Estevez, Arturo
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 29.03.2018
• Subjects: FPGA; Interaural intensity difference; Neuromorphic auditory sensor; Neurorobotics; Sound localization; Spike signal processing; Sound localization; Spike signal processing; Interaural intensity difference; Neurorobotics; FPGA; Neuromorphic auditory sensor
• ISSN: 0925-2312; 1872-8286
• DOI: 10.1016/j.neucom.2017.12.041

This paper proposes a real-time sound source localization and tracking architecture based on the ability of the mammalian auditory system using the interaural intensity difference. We used an innovative binaural Neuromorphic Auditory Sensor to obtain spike rates similar to those generated by the inner hair cells of the human auditory system. The design of the component that obtains the interaural intensity difference is inspired by the lateral superior olive. The spike stream that represents the IID is used to turn a robotic platform towards the sound source direction. The architecture was implemented on FPGA devices using general purpose FPGA resources and was tested with pure tones (1-kHz, 2.5-kHz and 5-kHz sounds) with an average error of 2.32°. Our architecture demonstrates a potential practical application of sound localization for robots, and can be used to test paradigms for sound localization in the mammalian brain.