Audio-based Active and Assisted Living: A review of selected applications and future trends

• Published in: Computers in biology and medicine Vol. 149; p. 106027
• Main Authors: Despotovic, Vladimir, Pocta, Peter, Zgank, Andrej
• Format: Journal Article
• Language: English
• Published: Oxford Elsevier Ltd 01.10.2022; Elsevier Limited
• Subjects: Active and Assisted Living; Audio data; Audio datasets; Audio modality; Audio-based AAL applications; Big Data; Emotion recognition; Fall detection; Food intake; Human activity recognition; Internet of Things; Machine learning; Monitoring; Trends; Workflow; Active and Assisted Living; Audio-based AAL applications; Audio modality; Audio datasets
• ISSN: 0010-4825; 1879-0534
• DOI: 10.1016/j.compbiomed.2022.106027

The development of big data, machine learning, and the Internet of Things has led to rapid advances in the research field of Active and Assisted Living (AAL). A human is placed in the center of such an environment, interacting with different modalities while using the system. Although video still plays a dominant role in AAL technologies, audio, as the most natural means of interaction, is also used commonly, either as a single source of information, or in combination with other modalities. Despite the rapidly increased research efforts in the last decade, there is a lack of systematic overview of audio based technologies and applications in AAL. This review tries to fill this gap, and identifies five major topics where audio is an essential AAL building block: Physiological monitoring, emotion recognition in the context of AAL, human activity recognition, fall detection, and food intake monitoring. We address the data work flow and standard sensing technologies for capturing audio in the AAL environment, provide a comprehensive overview of audio-based AAL applications, and identify datasets available to the research community. Finally, we address the main challenges that should be handled in the upcoming years, and try to identify the potential future trends in audio-based AAL. [Display omitted] •Comprehensive review of sensing technologies, datasets and applications of audio in AAL.•Audio can be standalone source of information, or combined with other modalities.•Challenges in deploying audio technologies in AAL and future trends are identified.•Creating benchmark platforms to facilitate the model evaluation is desirable.