Now Playing: Continuous low-power music recognition

Existing music recognition applications require a connection to a server that performs the actual recognition. In this paper we present a low-power music recognizer that runs entirely on a mobile device and automatically recognizes music without user interaction. To reduce battery consumption, a sma...

Full description

Saved in:
Bibliographic Details
Main Authors Arcas, Blaise Agüera y, Gfeller, Beat, Guo, Ruiqi, Kilgour, Kevin, Kumar, Sanjiv, Lyon, James, Odell, Julian, Ritter, Marvin, Roblek, Dominik, Sharifi, Matthew, Velimirović, Mihajlo
Format Journal Article
LanguageEnglish
Published 29.11.2017
Subjects
Computer Science - Artificial Intelligence
Computer Science - Sound
Online AccessGet full text

Cover

More Information
Summary:Existing music recognition applications require a connection to a server that performs the actual recognition. In this paper we present a low-power music recognizer that runs entirely on a mobile device and automatically recognizes music without user interaction. To reduce battery consumption, a small music detector runs continuously on the mobile device's DSP chip and wakes up the main application processor only when it is confident that music is present. Once woken, the recognizer on the application processor is provided with a few seconds of audio which is fingerprinted and compared to the stored fingerprints in the on-device fingerprint database of tens of thousands of songs. Our presented system, Now Playing, has a daily battery usage of less than 1% on average, respects user privacy by running entirely on-device and can passively recognize a wide range of music.
DOI:10.48550/arxiv.1711.10958