Accurate screw detection method based on faster R-CNN and rotation edge similarity for automatic screw disassembly

被引:29
|
作者
Li, Xinyu [1 ]
Li, Ming [1 ]
Wu, Yongfei [1 ,2 ]
Zhou, Daoxiang [1 ]
Liu, Tianyu [1 ]
Hao, Fang [1 ]
Yue, Junhong [1 ]
Ma, Qiyue [3 ]
机构
[1] Taiyuan Univ Technol, Coll Data Sci, Taiyuan, Peoples R China
[2] Univ Macau, Fac Sci & Technol, Dept Comp & Informat Sci, Macau, Peoples R China
[3] Taiyuan Univ Technol, Coll Software, Taiyuan, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning technology; screw detection method; faster R-CNN; rotation edge similarity; mobile phone mainboard; automated screw disassembly; SYSTEM;
D O I
10.1080/0951192X.2021.1963476
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Screw disassembly is a core operation in recycling electronic wastes (E-wastes), including mobile phone mainboards (MPMs). Currently, screw disassembly in most cases is still conducted manually which is inefficient and may adversely affect the health of workers. With the continuous development of intelligent manufacturing, a series of screw location methods have been designed to realise automated screw disassembly for various E-wastes. However, these methods cannot identify and classify tiny screws on complex MPMs. To overcome this limitation and expand the application domain of intelligent manufacturing, an accurate screw detection method, incorporating Faster R-CNN (high-performance deep learning algorithm) and an innovative rotation edge similarity (RES) algorithm, is proposed. In the experiments, the proposed method achieved a minuscule location deviation of 0.094 mm and satisfactory classification accuracy of 99.64%. The success rate and speed of automated screw disassembly for MPMs reached up to 90.8% and 4.98 s per screw, respectively. These results obtained from independently designed platforms confirm the practicality of the proposed method. However, incompleteness of detected screw groove edges can hamper the performance of RES; additionally, the computing speed of RES is currently unsatisfactory. In the future, solutions to the aforementioned drawbacks will be pertinently obtained.
引用
收藏
页码:1177 / 1195
页数:19
相关论文
共 50 条
  • [31] Automatic Paddy Planthopper Detection and Counting Using Faster R-CNN
    Khairunniza-Bejo, Siti
    Ibrahim, Mohd Firdaus
    Hanafi, Marsyita
    Jahari, Mahirah
    Saad, Fathinul Syahir Ahmad
    Bookeri, Mohammad Aufa Mhd
    AGRICULTURE-BASEL, 2024, 14 (09):
  • [32] A research for automatic pedestrian detection with ACE enhancement on Faster R-CNN
    Tian, Qing
    Wang, MeiHan
    Zhang, Yuan
    Wang, YanPing
    2018 11TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, BIOMEDICAL ENGINEERING AND INFORMATICS (CISP-BMEI 2018), 2018,
  • [33] Faster R-CNN With Classifier Fusion for Automatic Detection of Small Fruits
    Mai, Xiaochun
    Zhang, Hong
    Jia, Xiao
    Meng, Max Q. -H.
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2020, 17 (03) : 1555 - 1569
  • [34] An Automatic Object Detection and Location System applying Faster R-CNN
    Falquete, Rodrigo Bernardes
    Cavalieri, Daniel Cruz
    Pereira, Flavio Garcia
    2018 13TH IEEE INTERNATIONAL CONFERENCE ON INDUSTRY APPLICATIONS (INDUSCON), 2018, : 902 - 908
  • [35] Instrument recognition method based on Faster R-CNN
    Li Na
    Jiang Zhi
    Wang Jun
    Dong Xing-fa
    CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2020, 35 (12) : 1291 - 1298
  • [36] Railway Subgrade Defect Automatic Recognition Method Based on Improved Faster R-CNN
    Xu, Xinjun
    Lei, Yang
    Yang, Feng
    SCIENTIFIC PROGRAMMING, 2018, 2018
  • [37] A vehicle detection and tracking method for traffic video based on faster R-CNN
    Othmani, Mohamed
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (20) : 28347 - 28365
  • [38] Table Detection Method Based on Feature Pyramid Network with Faster R-CNN
    Liu, Yawen
    Jin, Yinghui
    Huang, Chenchao
    Bao, Wenzhi
    TWELFTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2020), 2020, 11519
  • [39] An optimized railway fastener detection method based on modified Faster R-CNN
    Bai, Tangbo
    Yang, Jianwei
    Xu, Guiyang
    Yao, Dechen
    MEASUREMENT, 2021, 182
  • [40] Image Detection Method for Broccoli Seedlings in Field Based on Faster R-CNN
    Sun Z.
    Zhang C.
    Ge L.
    Zhang M.
    Li W.
    Tan Y.
    Nongye Jixie Xuebao/Transactions of the Chinese Society for Agricultural Machinery, 2019, 50 (07): : 216 - 221