Listening Human Behavior: 3D Human Pose Estimation with Acoustic Signals

• Published in: Proceedings (IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Online) pp. 13323 - 13332
• Main Authors: Shibata, Yuto, Kawashima, Yutaka, Isogawa, Mariko, Irie, Go, Kimura, Akisato, Aoki, Yoshimitsu
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.06.2023
• Subjects: Acoustics; body; Feature extraction; gesture; Humans: Face; movement; pose; Pose estimation; Privacy; Shape; Three-dimensional displays; Visualization

Given only acoustic signals without any high-level information, such as voices or sounds of scenes/actions, how much can we infer about the behavior of humans? Unlike existing methods, which suffer from privacy issues because they use signals that include human speech or the sounds of specific actio...