24GHz FMCW Radar Based Lightweight Real-time Hand Gesture Recognition System

被引:0
|
作者
Song, Xinghui [1 ]
Liu, Ruizhi [1 ]
Jiang, Botao [1 ]
Lin, Yue [2 ]
Xu, Hongtao [1 ]
机构
[1] Fudan Univ, State Key Lab ASIC & Syst, Shanghai, Peoples R China
[2] ICLegend Micro, Suzhou, Peoples R China
关键词
millimeter wave radar; hand gesture recognition; lightweight neural network; point cloud; super precision;
D O I
10.1109/IWS61525.2024.10713775
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
In this paper, we propose a lightweight real-time gesture recognition system based on hand trajectory caught by 24GHz FMCW radar. To catch a reliable hand trajectory, we employ a computationally efficient local interpolation method to achieve super-precision positioning of the hand. Combined with lightweight neural networks for gesture capture and classification, high accuracy is achieved with minimal computational and resource consumption. After data augmentation for training, validation accuracy for 10 gestures can reach 97.5%, with the entire parameter size of only 0.02MB. The entire process from receiving raw radar data to outputting gesture recognition results takes only 6ms on a low-cost Microcontroller Unit.
引用
收藏
页数:3
相关论文
共 50 条
  • [31] Short-Range Radar Based Real-Time Hand Gesture Recognition Using LSTM Encoder
    Choi, Jae-Woo
    Ryu, Si-Jung
    Kim, Jong-Hwan
    IEEE ACCESS, 2019, 7 : 33610 - 33618
  • [32] Synthetic Training Data Generator for Hand Gesture Recognition Based on FMCW RADAR
    Zhao, Yanhua
    Sark, Vladica
    Krstic, Milos
    Grass, Eckhard
    2022 23RD INTERNATIONAL RADAR SYMPOSIUM (IRS), 2022, : 463 - 468
  • [33] Real-Time Human Motion Tracking Technique Based On a 77 GHz FMCW MIMO Radar System
    Zhang, Jiayu
    Zhang, Zhiwei
    Li, Yuchen
    Ge, Changzhan
    Mao, Junfa
    2024 INTERNATIONAL CONFERENCE ON MICROWAVE AND MILLIMETER WAVE TECHNOLOGY, ICMMT, 2024,
  • [34] Multiple Objects Recognition system for Intelligent Vehicle System using 24GHz Radar
    Choi, Baehoon
    Lee, Heesung
    Kim, Euntai
    2011 11TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS), 2011, : 1911 - 1914
  • [35] Design and Implementation of a Miniaturized 24GHz FMCW Radar with High-resolution
    Wang, Changlei
    Xu, Gang
    Gao, Zhuoyuan
    Hong, Wei
    2019 INTERNATIONAL SYMPOSIUM ON ANTENNAS AND PROPAGATION (ISAP 2019), 2019,
  • [36] Real-time Hand Gesture Recognition Based on A Fusion Learning Method
    Wang, Weihang
    Ying, Rendong
    Qian, Jiuchao
    Ge, Hao
    Wang, Jun
    Liu, Peilin
    PROCEEDINGS 2017 INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND COMPUTATIONAL INTELLIGENCE (CSCI), 2017, : 535 - 540
  • [37] An interactive game for rehabilitation based on real-time hand gesture recognition
    Chen, Jiang
    Zhao, Shuying
    Meng, Huaning
    Cheng, Xu
    Tan, Wenjun
    FRONTIERS IN PHYSIOLOGY, 2022, 13
  • [38] A Continuous Real-time Hand Gesture Recognition Method based on Skeleton
    Tien-Thanh Nguyen
    Nam-Cuong Nguyen
    Duy-Khanh Ngo
    Viet-Lam Phan
    Minh-Hung Pham
    Duc-An Nguyen
    Minh-Hiep Doan
    Thi-Lan Le
    2022 11TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND INFORMATION SCIENCES (ICCAIS), 2022, : 273 - 278
  • [39] Real-time Hand Gesture Recognition Based on Feature Points Extraction
    Zaghbani, Soumaya
    Jaouedi, Neziha
    Boujnah, Noureddine
    Bouhlel, Mohamed Salim
    NINTH INTERNATIONAL CONFERENCE ON MACHINE VISION (ICMV 2016), 2017, 10341
  • [40] Real-time gesture recognition for controlling a virtual hand
    Moldovan, Catalin Constantin
    Staretu, Ionel
    OPTIMIZATION OF THE ROBOTS AND MANIPULATORS, 2011, 8 : 150 - 154