Multimodal Gesture Recognition Based on Choquet Integral

被引：0
|
作者：
Hirota, K. [1 ]
Vu, H. A. [1 ]
Le, P. Q. [1 ]
Fatichah, C. [1 ]
Liu, Z. [1 ]
Tang, Y. [1 ]
Tangel, M. L. [1 ]
Mu, Z. [1 ]
Sun, B. [1 ]
Yan, F. [1 ]
Masano, D. [1 ]
Thet, O. [1 ]
Yamaguchi, M. [1 ]
Dong, F. [1 ]
Yamazaki, Y. [2 ]
机构：
[1] Tokyo Inst Technol, Dept Computat Intelligence & Syst Sci, Yokohama, Kanagawa 227, Japan
[2] Kanto Gakuin Univ, Dept Electr Electron & Informat Engn, Yokohama, Kanagawa, Japan
来源：
IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS (FUZZ 2011) | 2011年
关键词：
Gesture Recognition; Sensor Fusion; Choquet Integral; Human-Robot Interaction; 3D Accelerometer;
D O I：
暂无
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
A multimodal gesture recognition method is proposed based on Choquet integral by fusing information from camera and 3D accelerometer data. By calculating the optimal fuzzy measures for the camera recognition module and the accelerometer recognition module, the proposal obtains enough recognition rate 92.7% in average for 8 types of gestures by improving the recognition rate approximate 20% compared to that of each module. The proposed method aims to realize the casual communication from humans to robots by integrating nonverbal gesture messages and verbal messages.
引用
收藏
页码：772 / 776
页数：5
相关论文
共 50 条
  • [1] Multimodal Gesture Recognition for Mascot Robot System Based on Choquet Integral Using Camera and 3D Accelerometers Fusion
    Tang, Yongkang
    Vu, Hai An
    Le, Phuc Q.
    Masano, Daisuke
    Thet, Oo Han
    Fatichah, Chastine
    Liu, Zhentao
    Yamaguchi, Masashi
    Tangel, Martin Leonard
    Dong, Fangyan
    Yamazaki, Yoichi
    Hirota, Kaoru
    JOURNAL OF ADVANCED COMPUTATIONAL INTELLIGENCE AND INTELLIGENT INFORMATICS, 2011, 15 (05) : 563 - 572
  • [2] Feature Selection based on Choquet Integral for Human Activity Recognition
    Jarraya, Amina
    Arour, Khedija
    Bouzeghoub, Amel
    Borgi, Amel
    2017 IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS (FUZZ-IEEE), 2017,
  • [3] Generalized Choquet Integral for Face Recognition
    Paweł Karczmarek
    Adam Kiersztyn
    Witold Pedrycz
    International Journal of Fuzzy Systems, 2018, 20 : 1047 - 1055
  • [4] Generalized Choquet Integral for Face Recognition
    Karczmarek, Pawel
    Kiersztyn, Adam
    Pedrycz, Witold
    INTERNATIONAL JOURNAL OF FUZZY SYSTEMS, 2018, 20 (03) : 1047 - 1055
  • [5] Dynamic Gesture Recognition Based On Multimodal Fusion Model
    Fang, Juan
    Xu, Chao
    Wang, Chao
    Li, Hua
    20TH INT CONF ON UBIQUITOUS COMP AND COMMUNICAT (IUCC) / 20TH INT CONF ON COMP AND INFORMATION TECHNOLOGY (CIT) / 4TH INT CONF ON DATA SCIENCE AND COMPUTATIONAL INTELLIGENCE (DSCI) / 11TH INT CONF ON SMART COMPUTING, NETWORKING, AND SERV (SMARTCNS), 2021, : 172 - 177
  • [6] Gesture recognition based on multilevel multimodal feature fusion
    Tian, Jinrong
    Cheng, Wentao
    Sun, Ying
    Li, Gongfa
    Jiang, Du
    Jiang, Guozhang
    Tao, Bo
    Zhao, Haoyi
    Chen, Disi
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2020, 38 (03) : 2539 - 2550
  • [7] Challenges in multimodal gesture recognition
    Escalera, Sergio
    Athitsos, Vassilis
    Guyon, Isabelle
    JOURNAL OF MACHINE LEARNING RESEARCH, 2016, 17
  • [8] Conditional aggregation-based Choquet integral as a Choquet integral on a hyperspace
    Borzova, Jana
    Halcinova, Lenka
    Supina, Jaroslav
    FUZZY SETS AND SYSTEMS, 2024, 492
  • [9] Multimodal (Audio, Facial and Gesture) based Emotion Recognition challenge
    Wei, Gou
    Li Jian
    Mo, Sun
    2020 15TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2020), 2020, : 908 - 911
  • [10] The Choquet fuzzy integral in handwritten word recognition
    Gader, PD
    Mohamed, MA
    DOCUMENT RECOGNITION III, 1996, 2660 : 309 - 320
12345