Empty yarn bobbin positioning method based on machine vision

被引:0
|
作者
Shi W. [1 ]
Han S. [1 ]
Tu J. [1 ,2 ]
Lu W. [1 ]
Duan Y. [1 ]
机构
[1] Key Laboratory of Modern Textile Machinery & Technology of Zhejiang Province, Zhejiang Sci-Tech University, Zhejiang, Hangzhou
[2] School of Automation, Zhejiang Institute of Mechanical & Electrical Engineering, Zhejiang, Hangzhou
来源
关键词
automatic bobbin changing; ellipse fitting; machine vision; monocular camera positioning; yarn bobbin; Yolov5;
D O I
10.13475/j.fzxb.20220605501
中图分类号
学科分类号
摘要
Objective In the automatic production line of circular weft knitting robot, the position of the bobbin mouth will change due to the influence of the gravity of the bobbin, the vibration when the bobbin is released, the sliding and other factors during the automatic bobbin changing process of the bobbin changing robot. All these will affect the grasping of the empty bobbin by the mechanical claw. In order to ensure the accurate grasp of the empty yarn bobbin by the mechanical claw, it is necessary to locate the position of the empty yarn bobbin. Method Improved Yolov5 model was adopted to frame the position of the bobbin mouth in the picture, then the Sobel edge detection, threshold segmentation, filtering, and closing operations were adopted to process the image of the framed area, and the empty yarn bobbin aperture and center coordinates were obtained by least square fitting. Finally, the pinhole imaging principle of a monocular camera is adopted to locate the bobbin mouth. Results In terms of model recognition, the accuracy of the four models experimented in this research was more than 99%. The accuracy of the model with the attention mechanism alone was decreased by 0.1%, but the speed was increased. After adding Ghost module alone, the accuracy was reduced by 0.2% relative to the original model, but the number of parameters was reduced by about half of the volume relative to the original model, and the speed is also increased. The accuracy of the new model with Ghost and CBAM modules is 99.2%, the number of parameters is 3.71 M, and the detection speed is 54.3 frames/s. It can be seen that the improved model maintains high accuracy, and has a smaller volume and faster detection speed. The comprehensive performance is better. In terms of yarn bobbin positioning, the maximum absolute values of yarn mouth positioning errors of the drum changing robot on X axis, Y axis and Z axis were 1.3, 1.9 and 0.7 mm, respectively, and the errors of the three axes were all within the allowable range of errors. Under the same testing environment, the detection time of the positioning method based on deep learning is about 2 s, with contrast to the 5 s detection time of the conventional method. The time efficiency of the proposed method was improved by about 150%. Compared with deep learning, conventional algorithms were more susceptible to the influence of environment, which was prone to interference during contour fitting leading to failure in fitting the yarn bobbin correctly. The deep learning method was shown to be able to eliminate the interference of environment effectively and provide favorable conditions for yarn fitting. Conclusion In this paper, a positioning method combining depth learning with conventional image processing is proposed to solve the problem of empty yarn bobbin opening positioning when the yarn bobbin changing truss robot takes empty yarn bobbin from the yarn frame in the automatic production line of circular weft knitting machine. The improved Yolov5 model is adopted to frame the approximate position of the bobbin mouth, and then the information of the empty yarn bobbin mouth is obtained through image processing of conventional algorithms and ellipse contour fitting. The monocular camera ranging principle is adopted to locate the empty yarn bobbin mouth. The experiment proves that the improved model has smaller volume and higher accuracy, and the positioning result error is also within the allowable range, which basically meets the requirements of empty yarn bobbin positioning function of the yarn bobbin changing truss robot, providing a reference for the improvement and development of automatic yarn bobbin changing technology in the textile industry. © 2023 China Textile Engineering Society. All rights reserved.
引用
收藏
页码:105 / 112
页数:7
相关论文
共 14 条
  • [1] LI Feifei, Research on on-line detection of fabric defect marks and positioning of defective samples [D], pp. 1-4, (2015)
  • [2] WANG Ning, Intelligent manufacturing promotes the dynamic transformation of my country's textile trade comparative advantages, Practice in Foreign Economic Relations and Trade, 11, pp. 36-41, (2021)
  • [3] ZHANG Wenchang, SHAN Zhongde, LU Ying, Rapid positioning method of sarong yarn rod based on machine vision[J], Journal of Textile Research, 41, 12, pp. 137-143, (2020)
  • [4] TU J, HAN S, SUN L, Et al., The method of creel positioning based on monocular vision [J], Sensors, (2022)
  • [5] ZHANG Jianxin, UI Qi, On-line detection system for cheese density based on machine vision, Journal of Textile Researcgh, 41, 6, pp. 141-146, (2020)
  • [6] SHI Z, SHI W, WANG J., The detection of thread roll's Margin based on computer vision [J], Sensors, (2021)
  • [7] LI Jingyu, SHEN Danfeng, WANG Yu, Et al., Recognition and detection of cheese yarn based on parameter adjustable mean shift filtering [J], Light Industry Machinery, 39, 3, pp. 63-68, (2021)
  • [8] JIN Shoufeng, LIN Qiangqiang, MA Qiurui, Cheese grabbing method based on adversarial neural network and neural network model, Wool Textile Journal, 48, 1, pp. 79-84, (2020)
  • [9] LIN Qingping, ZHANG Qilin, XIAO Lei, Remote sensing image target recognition method using improved YOLOv5 network, Journal of Air Force Early Warning Academy, 35, 2, pp. 117-120, (2021)
  • [10] HAN K, WANG Y, TIAN Q, Et al., GhostNet: more features from cheap operations, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1577-1586, (2020)