Adaptive and Robust Mmwave-Based 3D Human Mesh Estimation for Diverse Poses

• Published in: 2023 IEEE International Conference on Image Processing (ICIP) pp. 455 - 459
• Main Authors: Amaya, Kotaro, Isogawa, Mariko
• Format: Conference Proceeding
• Language: English
• Published: IEEE 08.10.2023
• Subjects: 3D human mesh estimation; 3D human pose estimation; Estimation; Feature extraction; Millimeter wave devices; millimeter-wave; Noise measurement; Noise reduction; Shape; signal denoising; Three-dimensional displays
• DOI: 10.1109/ICIP49359.2023.10222059

This paper proposes a three-dimensional (3D) human mesh estimation framework with only a single commercial portable millimeter-wave device. Perceiving a 3D human mesh that includes poses and body shapes of a person with such a simple setting has remarkable potential for various applications such as daily activity monitoring and motion analysis for sports enhancement. Due to estimation difficulties, given a noisy input that includes signals reflected from the other person or objects in addition to the target person, most existing studies implicitly assume that the person stands almost vertically or that there is nothing else to be observed. Since such situations are unlikely to occur in real life, there is an urgent need for a more practical method. Therefore, we propose a framework that has the ability to extract only signals reflected from the target person and obtain local features that flexibly fit various poses that humans can take, including horizontal postures, such as lying. Our experiments suggest that the framework works effectively and that our method outperforms the baseline method.