Robotics multi-modal recognition system via computer-based vision

被引：0

作者：

Shahin, Mohammad ^{[1
]}

Chen, F. Frank ^{[1
]}

Hosseinzadeh, Ali ^{[1
]}

Bouzary, Hamed ^{[1
]}

Shahin, Awni ^{[2
]}

机构：

[1] Mechanical Engineering Department, The University of Texas at San Antonio, San Antonio, United States

[2] Faculty of Education, Mu’tah University, Karak, Jordan

来源：

International Journal of Advanced Manufacturing Technology | 2024年

关键词：

This paper presents a multi-modal recognition system (MMR) which can eliminates the need for using Barcodes and Radio Frequency Identification Systems (RFIDs). Barcodes and RFID have limitations; for example, Barcodes require the scanner to have a direct line of sight with the code, and they are more susceptible to errors. Barcodes can also be hard to locate and can be affixed to oddly shaped products. While, RFID may overcome such problems, but it could be disturbed if the RFID is attached to a metallic background. The proposed MMR system can monitor items flowing one by one down on a conveyor belt to make sure they match their images, thus enabling robotics identification for items while picking them up, sorting them or turning them into a desirable orientation. Recognizing the business landscape evolves and competition from low-cost nations grows, new models must be created that provide a competitive edge by combining the Lean paradigm with Industry 4.0 technical advancements. This paper reports a contribution to this field by assessing the supporting function of MMR state-of-the-art algorithms in Lean manufacturing. In addition, this paper also aims to explore how MMR could be integrated into the Lean manufacturing settings to enable a competitive manufacturing process in a Lean 4.0 environment. A dataset with 21,000 vegetable images of 15 classes was used to present the recent development and application of image analysis and computer vision systems in object recognition, showing an overall detection F1-score of 85.08%. © The Author(s), under exclusive licence to Springer-Verlag London Ltd., part of Springer Nature 2024;

D O I：

暂无

中图分类号：

学科分类号：

摘要：

Article in Press

引用

共 50 条

[31] A multi-modal deep learning system for Arabic emotion recognition
Abu Shaqra F.
Duwairi R.
Al-Ayyoub M.
International Journal of Speech Technology, 2023, 26 (01) : 123 - 139
[32] MEM: Multi-Modal Elevation Mapping for Robotics and Learning
Erni, Gian
Frey, Jonas
Miki, Takahiro
Mattamala, Matias
Hutter, Marco
2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2023, : 11011 - 11018
[33] Motion description languages for multi-modal control in robotics
Egerstedt, M
CONTROL PROBLEMS IN ROBOTICS, 2003, 4 : 75 - 89
[34] On Robustness of Multi-Modal Fusion-Robotics Perspective
Bednarek, Michal
Kicki, Piotr
Walas, Krzysztof
ELECTRONICS, 2020, 9 (07) : 1 - 17
[35] A Survey of Multi-modal Question Answering Systems for Robotics
Liu, Xiaomeng
Long, Fei
2017 2ND INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND MECHATRONICS (ICARM), 2017, : 189 - 194
[36] A multi-modal haptic interface for virtual reality and robotics
Folgheraiter, Michele
Gini, Giuseppina
Vercesi, Dario
JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2008, 52 (3-4) : 465 - 488
[37] A Multi-Modal Haptic Interface for Virtual Reality and Robotics
Michele Folgheraiter
Giuseppina Gini
Dario Vercesi
Journal of Intelligent and Robotic Systems, 2008, 52 : 465 - 488
[38] Development of a Human Computer Interaction System Based on Multi-Modal Gaze Tracking Methods
Han, Shuning
Liu, Rensong
Zhu, Chi
Soo, Yew Guan
Yu, Haoyong
Liu, Tianming
Duan, Feng
2016 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO), 2016, : 1894 - 1899
[39] A COMPUTER-BASED SYSTEM FOR THE RECOGNITION OF SEED SHAPE
TRAVIS, AJ
DRAPER, SR
SEED SCIENCE AND TECHNOLOGY, 1985, 13 (03) : 813 - 820
[40] MULTI-MODAL LEARNING FOR GESTURE RECOGNITION
Cao, Congqi
Zhang, Yifan
Lu, Hanqing
2015 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO (ICME), 2015,

← 1 2 3 4 5 →