Technical Note: Quantifying music-dance synchrony during salsa dancing with a deep learning-based 2D pose estimator

Dance interventions hold promise for improving gait and balance in people with neurological conditions. It is possible that synchronization of movement to the music is one of the mechanisms through which dance bestows physical benefits. This technical note will describe a novel method using a deep l...

Full description

Saved in:
Bibliographic Details
Published inJournal of biomechanics Vol. 141; p. 111178
Main Authors Potempski, Filip, Sabo, Andrea, Patterson, Kara K.
Format Journal Article
LanguageEnglish
Published Kidlington Elsevier Ltd 01.08.2022
Elsevier Limited
Subjects
Balance
Cameras
Dance
Dancers & choreographers
Dancing
Deep learning
Digital audio workstations
Exports
Gait
Human pose tracking algorithm
Internet
Motion analysis
Music
Musical recordings
Open source software
OpenPose
Salsa dance
Synchronism
Synchronization
Two dimensional analysis
Waveforms
Webcams
Human pose tracking algorithm
Dancing
Synchronization
Motion analysis
OpenPose
Online AccessGet full text

Cover

More Information
Summary:Dance interventions hold promise for improving gait and balance in people with neurological conditions. It is possible that synchronization of movement to the music is one of the mechanisms through which dance bestows physical benefits. This technical note will describe a novel method using a deep learning-based 2D pose estimator: OpenPose, alongside beat analysis of music to quantify movement-music synchrony during salsa dancing. This method has four components: i) camera setup and recording, ii) tempo/downbeat analysis and waveform cleanup, iii) OpenPose estimation and data extraction, and iv) synchronization analysis. Four participants performed a solo basic salsa step continuously for 90 s to a salsa track while their movements and the music were recorded with a webcam. Two conditions were recorded for each participant: one in which they danced on the beat of the music and one where they did not. This data was then extracted from OpenPose and analyzed. Median asynchrony values highlighted differences between participants with and without dance training and between on– and off-beat conditions, indicating that this method may be an effective means to quantify a dancer’s asynchrony while performing a basic salsa step.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
ISSN:0021-9290
1873-2380
DOI:10.1016/j.jbiomech.2022.111178