Gesture recognition method and device, electronic equipment and storage medium

The invention relates to the technical field of action recognition, and provides a gesture recognition method and device, electronic equipment and a storage medium, and the method comprises the steps: collecting a surface electromyogram signal and a video stream corresponding to each gesture action;...

Full description

Saved in:
Bibliographic Details
Main Authors TONG LINA, WANG CHEN, YANG FAN, PENG LIANG, HOU ZENGGUANG, QIAN YIHUI
Format Patent
LanguageChinese
English
Published 06.02.2024
Subjects
CALCULATING
COMPUTING
COUNTING
ELECTRIC DIGITAL DATA PROCESSING
PHYSICS
Online AccessGet full text

Cover

More Information
Summary:The invention relates to the technical field of action recognition, and provides a gesture recognition method and device, electronic equipment and a storage medium, and the method comprises the steps: collecting a surface electromyogram signal and a video stream corresponding to each gesture action; preprocessing the surface electromyogram signal to obtain a signal time-frequency diagram, extracting a key frame from a video stream, and determining video optical stream information by using the key frame; carrying out feature extraction on the signal time-frequency diagram to obtain signal time-frequency features, and respectively carrying out feature extraction on the key frame and the video light stream information to obtain video spatial stream features and video time stream features; fusing the signal time-frequency feature, the video spatial stream feature and the video time stream feature to obtain a fused feature; and carrying out gesture classification by using the fused features to determine gesture ca
Bibliography:Application Number: CN202311542550