Multimodal gesture recognition based on Choquet integral

A multimodal gesture recognition method is proposed based on Choquet integral by fusing information from camera and 3D accelerometer data. By calculating the optimal fuzzy measures for the camera recognition module and the accelerometer recognition module, the proposal obtains enough recognition rat...

Full description

Saved in:
Bibliographic Details
Published in2011 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2011) pp. 772 - 776
Main Authors Hirota, K., Vu, H. A., Le, P. Q., Fatichah, C., Liu, Z., Tang, Y., Tangel, M. L., Mu, Z., Sun, B., Yan, F., Masano, D., Thet, O., Yamaguchi, M., Dong, F., Yamazaki, Y.
Format Conference Proceeding
LanguageEnglish
Published IEEE 01.01.2011
Subjects
3D Accelerometer
Accelerometers
Cameras
Choquet Integral
Gesture recognition
Human-Robot Interaction
Humans
Robot sensing systems
Sensor Fusion
Training data
Online AccessGet full text

Cover

More Information
Summary:A multimodal gesture recognition method is proposed based on Choquet integral by fusing information from camera and 3D accelerometer data. By calculating the optimal fuzzy measures for the camera recognition module and the accelerometer recognition module, the proposal obtains enough recognition rate 92.7% in average for 8 types of gestures by improving the recognition rate approximate 20% compared to that of each module. The proposed method aims to realize the casual communication from humans to robots by integrating nonverbal gesture messages and verbal messages.
ISBN:9781424473151
1424473152
ISSN:1098-7584
DOI:10.1109/FUZZY.2011.6007382