Automatic Evaluation Method for Functional Movement Screening Based on a Dual-Stream Network and Feature Fusion

被引:2
|
作者
Lin, Xiuchun [1 ]
Chen, Renguang [2 ]
Feng, Chen [3 ]
Chen, Zhide [2 ]
Yang, Xu [4 ]
Cui, Hui [5 ]
机构
[1] Fujian Inst Educ, Fuzhou 350025, Peoples R China
[2] Fujian Normal Univ, Coll Comp & Cyber Secur, Fuzhou 350117, Peoples R China
[3] Fuzhou Polytech, Dept Informat Engn, Fuzhou 350108, Peoples R China
[4] Minjiang Univ, Fuzhou Inst Oceanog, Coll Comp & Data Sci, Fuzhou 350108, Peoples R China
[5] Monash Univ, Dept Software Syst & Cybersecur, Melbourne, Vic 3800, Australia
基金
中国国家自然科学基金;
关键词
RAFT; dual stream; feature fusion; functional movement screening;
D O I
10.3390/math12081162
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Functional Movement Screening (FMS) is a movement pattern quality assessment system used to assess basic movement capabilities such as flexibility, stability, and pliability. Movement impairments and abnormal postures can be identified through peculiar movements and postures of the body. The reliability, validity, and accuracy of functional movement screening are difficult to test due to the subjective nature of the assessment. In this sense, this paper presents an automatic evaluation method for functional movement screening based on a dual-stream network and feature fusion. First, the RAFT algorithm is used to estimate the optical flow of a video, generating a set of optical flow images to represent the motion between consecutive frames. By inputting optical flow images and original video frames separately into the I3D model, it can better capture spatiotemporal features compared to the single-stream method. Meanwhile, this paper introduces a simple but effective attention fusion method that combines features extracted from optical flow with the original frames, enabling the network to focus on the most relevant parts of the input data, thereby improving prediction accuracy. The prediction of the four categories of FMS results was performed. It produced better correlation results compared to other more complex fusion protocols, with an accuracy improvement of 3% over the best-performing fusion method. Tests on public datasets showed that the evaluation metrics of the method proposed in this paper were the most advanced, with an accuracy improvement of approximately 4% compared to the currently superior methods. The use of deep learning methods makes it more objective and reliable to identify human movement impairments and abnormal postures.
引用
收藏
页数:16
相关论文
共 50 条
  • [41] Visual Odometry Based on Improved Dual-Stream Network Structure
    Zhang Haidong
    Xu Yiming
    Wang Li
    Bian Chunlei
    Zhou Fangjie
    LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (20)
  • [42] Dual-stream network with complementary fusion and hierarchical attention for image tampering localization
    Mao, Zhanpeng
    Lu, Tongwei
    SIGNAL IMAGE AND VIDEO PROCESSING, 2025, 19 (03)
  • [43] GDSNet: A gated dual-stream convolutional neural network for automatic recognition of coseismic landslides
    Wang, Xuewen
    Wang, Xianmin
    Zheng, Yuchen
    Liu, Zhiwei
    Xia, Wenxiang
    Guo, Haixiang
    Li, Dongdong
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2024, 127
  • [44] LDDG: Long-distance dependent and dual-stream guided feature fusion network for co-saliency object detection
    Wei, Longsheng
    Guo, Siyuan
    Huang, Jiu
    Fan, Xuan
    DISPLAYS, 2024, 84
  • [45] Surface Defect Detection Method for Industrial Products Based on Photometric Stereo and Dual Stream Feature Fusion Network
    Hu, Guanghua
    Tu, Qianxi
    Huanan Ligong Daxue Xuebao/Journal of South China University of Technology (Natural Science), 2024, 52 (10): : 112 - 123
  • [46] Efficient Dual-Stream Fusion Network for Real-Time Railway Scene Understanding
    Cao, Zhiwei
    Gao, Yang
    Bai, Jie
    Qin, Yong
    Zheng, Yuanjin
    Jia, Limin
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (08) : 9442 - 9452
  • [47] DeReFNet: Dual-stream Dense Residual Fusion Network for static hand gesture recognition
    Sahoo, Jaya Prakash
    Sahoo, Suraj Prakash
    Ari, Samit
    Patra, Sarat Kumar
    DISPLAYS, 2023, 296
  • [48] Efficient Dual-Stream Fusion Network for Real-Time Railway Scene Understanding
    Cao, Zhiwei
    Gao, Yang
    Bai, Jie
    Qin, Yong
    Zheng, Yuanjin
    Jia, Limin
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (08) : 9442 - 9452
  • [49] DUAL-STREAM NETWORK BASED ON GLOBAL GUIDANCE FOR SALIENT OBJECT DETECTION
    Gao, Shuyong
    Guo, Qianyu
    Zhang, Wei
    Zhang, Wenqiang
    Ji, Zhongwei
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 1495 - 1499
  • [50] TransMatch: A Transformer-Based Multilevel Dual-Stream Feature Matching Network for Unsupervised Deformable Image Registration
    Chen, Zeyuan
    Zheng, Yuanjie
    Gee, James C.
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2024, 43 (01) : 15 - 27