Through-Wall Human Pose Estimation Using Radio Signals

This paper demonstrates accurate human pose estimation through walls and occlusions. We leverage the fact that wireless signals in the WiFi frequencies traverse walls and reflect off the human body. We introduce a deep neural network approach that parses such radio signals to estimate 2D poses. Sinc...

Full description

Saved in:
Bibliographic Details
Published in2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition pp. 7356 - 7365
Main Authors Zhao, Mingmin, Li, Tianhong, Alsheikh, Mohammad Abu, Tian, Yonglong, Zhao, Hang, Torralba, Antonio, Katabi, Dina
Format Conference Proceeding
LanguageEnglish
Published IEEE 01.06.2018
Subjects
Heating systems
Pose estimation
Radio frequency
RF signals
Visualization
Wireless communication
Wireless sensor networks
Online AccessGet full text

Cover

More Information
Summary:This paper demonstrates accurate human pose estimation through walls and occlusions. We leverage the fact that wireless signals in the WiFi frequencies traverse walls and reflect off the human body. We introduce a deep neural network approach that parses such radio signals to estimate 2D poses. Since humans cannot annotate radio signals, we use state-of-the-art vision model to provide cross-modal supervision. Specifically, during training the system uses synchronized wireless and visual inputs, extracts pose information from the visual stream, and uses it to guide the training process. Once trained, the network uses only the wireless signal for pose estimation. We show that, when tested on visible scenes, the radio-based system is almost as accurate as the vision-based system used to train it. Yet, unlike vision-based pose estimation, the radio-based system can estimate 2D poses through walls despite never trained on such scenarios. Demo videos are available at our website.
ISSN:1063-6919
DOI:10.1109/CVPR.2018.00768