Shallow Convolutional Neural Networks for Human Activity Recognition Using Wearable Sensors

被引:80
|
作者
Huang, Wenbo [1 ]
Zhang, Lei [1 ]
Gao, Wenbin [1 ]
Min, Fuhong [1 ]
He, Jun [2 ]
机构
[1] Nanjing Normal Univ, Sch Elect & Automat Engn, Nanjing 210023, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Sch Elect & Informat Engn, Nanjing 210044, Peoples R China
基金
美国国家科学基金会;
关键词
Convolutional neural networks (CNNs); cross-channel communication; deep learning; human activity recognition (HAR); sensor;
D O I
10.1109/TIM.2021.3091990
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Due to rapid development of sensor technology, human activity recognition (HAR) using wearable inertial sensors has recently become a new research hotspot. Deep learning, especially convolutional neural network (CNN) that can automatically learn intricate activity features have gained a lot of attention in ubiquitous HAR task. Most existing CNNs process sensor input by extracting channel-wise features, and the information from each channel can be separately propagated in a hierarchical way from lower layers to higher layers. As a result, they typically overlook information exchange among channels within the same layer. In this article, we first propose a shallow CNN that considers cross-channel communication in HAR scenario, where all channels in the same layer have a comprehensive interaction to capture more discriminative features of sensor input. One channel can communicate with all other channels by graph neural network to remove redundant information accumulated among channels, which is more beneficial for deploying lightweight deep models. Extensive experiments are conducted on multiple benchmark HAR datasets, namely UCI-HAR, OPPORTUNITY, PAMAP2 and UniMib-SHAR, which indicates that the proposed method enables shallower CNNs to aggregate more useful information, and surpasses baseline deep networks and other competitive methods. The inference speed is evaluated via deploying the HAR systems on an embedded system.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] A Survey on Human Activity Recognition using Wearable Sensors
    Lara, Oscar D.
    Labrador, Miguel A.
    IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2013, 15 (03): : 1192 - 1209
  • [32] Physical Human Activity Recognition Using Wearable Sensors
    Attal, Ferhat
    Mohammed, Samer
    Dedabrishvili, Mariam
    Chamroukhi, Faicel
    Oukhellou, Latifa
    Amirat, Yacine
    SENSORS, 2015, 15 (12) : 31314 - 31338
  • [33] Personalized models for human activity recognition with wearable sensors: deep neural networks and signal processing
    Gholamiangonabadi, Davoud
    Grolinger, Katarina
    APPLIED INTELLIGENCE, 2023, 53 (05) : 6041 - 6061
  • [34] Personalized models for human activity recognition with wearable sensors: deep neural networks and signal processing
    Davoud Gholamiangonabadi
    Katarina Grolinger
    Applied Intelligence, 2023, 53 : 6041 - 6061
  • [35] Computed Tomography Image Recognition with Convolutional Neural Network Using Wearable Sensors
    He, Yuqing
    Lei, Lei
    Yang, Guangsong
    Chen, Chih-Cheng
    Chan, Christopher Chun Ki
    Lai, Kuei-Kuei
    SENSORS AND MATERIALS, 2020, 32 (10) : 3517 - 3530
  • [36] The Convolutional Neural Networks Training With Channel-Selectivity for Human Activity Recognition Based on Sensors
    Huang, Wenbo
    Zhang, Lei
    Teng, Qi
    Song, Chaoda
    He, Jun
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2021, 25 (10) : 3834 - 3843
  • [37] Image encoding and wearable sensors-based locomotion mode recognition using convolutional recurrent neural networks
    Madaoui, Lotfi
    Amira, Abbes
    Talha, Malika Kedir
    Kerdjidj, Oussama
    Himeur, Yassine
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2025, 100
  • [38] Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
    Ordonez, Francisco Javier
    Roggen, Daniel
    SENSORS, 2016, 16 (01)
  • [39] HUMAN ACTIVITY DETECTION AND ACTION RECOGNITION IN VIDEOS USING CONVOLUTIONAL NEURAL NETWORKS
    Basavaiah, Jagadeesh
    Patil, Chandrashekar Mohan
    JOURNAL OF INFORMATION AND COMMUNICATION TECHNOLOGY-MALAYSIA, 2020, 19 (02): : 157 - 183
  • [40] Human locomotion activity recognition using spectral analysis and convolutional neural networks
    Amer, Ahmad
    Ji, Ze
    INTERNATIONAL JOURNAL OF MANUFACTURING RESEARCH, 2021, 16 (04) : 350 - 364