Real-time Machine Vision System for the Visually Impaired

被引：0
|
作者：
Krishna A.N. [1 ]
Chaitra Y.L. [2 ]
Bharadwaj A.M. [1 ]
Abbas K.T. [1 ]
Abraham A. [1 ]
Prasad A.S. [1 ]
机构：
[1] Department of CSE, SJB Institute of Technology, Affiliated to VTU, Karnataka, Bengaluru
[2] Department of CSE, BNM Institute of Technology, Affiliated to VTU, Karnataka, Bengaluru
来源：
SN Computer Science | / 5卷 / 4期
关键词：
Chatbot; Object detection; Personal assistant; Yolov4-tiny;
D O I：
10.1007/s42979-024-02741-4
中图分类号：
学科分类号：
摘要：
This work aims to provide a robust assistive system that uses the interface of a conversational chatbot to guide people who are blind in outdoor navigation. The proposed system will also be aware of situations where people close to the user are not wearing masks. We propose and analyze the effectiveness of a sophisticated system consisting of a mask detector, common objects detector and an obstacle avoidance system. The proposed system can be entirely hosted on a secure remote server and used on any smartphone with stable internet connectivity, with all the processing handled by the server. The responses each sub-system generates are transmitted back to the client, where the user listens to the response. The proposed system outperforms to detect masks with an accuracy of 99.51% and object detection with an 80.36% success rate, respectively. © The Author(s), under exclusive licence to Springer Nature Singapore Pte Ltd 2024. corrected publication 2024.
引用
收藏
相关论文
共 50 条
  • [41] Comparison of Three Smart Camera Architectures for Real-Time Machine Vision System
    Malik, Abdul Waheed
    Thornberg, Benny
    Kumar, Prasanna
    INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2013, 10
  • [42] Implementation of a Machine Vision System for Real-Time Traffic Sign Recognition on FPGA
    Aguirre-Dobernack, Nicolas
    Guzman-Miranda, Hipolito
    Aguirre, Miguel A.
    39TH ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY (IECON 2013), 2013, : 2285 - 2290
  • [43] Design of Real-time Steel Bars Recognition System Based on Machine Vision
    Zhao, Jianyu
    Xia, Xiangxiang
    Wang, Haodi
    Kong, Siwei
    2016 8TH INTERNATIONAL CONFERENCE ON INTELLIGENT HUMAN-MACHINE SYSTEMS AND CYBERNETICS (IHMSC), VOL. 1, 2016, : 505 - 509
  • [44] Assessment of citrus fruit quality using a real-time machine vision system
    Aleixos, N
    Blasco, J
    Moltó, E
    Navarrón, F
    15TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 1, PROCEEDINGS: COMPUTER VISION AND IMAGE ANALYSIS, 2000, : 482 - 485
  • [45] A real-time machine-vision system for monitoring the textile raising process
    Carfagni, M
    Furferi, R
    Governi, L
    COMPUTERS IN INDUSTRY, 2005, 56 (8-9) : 831 - 842
  • [46] Real-time Monitoring System of Dieless Bellows Forming using Machine Vision
    Supriadi, Sugeng
    Furushima, Tsuyoshi
    Manabe, Ken-ichi
    ADVANCES IN MATERIALS, PROCESSING AND MANUFACTURING, 2013, 789 : 429 - +
  • [47] Research of Real-time Grabbing Yarn Tube System Based on Machine Vision
    Cui, Shigang
    Dai, Fenghui
    Liang, Fan
    2015 7TH INTERNATIONAL CONFERENCE ON MECHANICAL AND ELECTRONICS ENGINEERING (ICMEE 2015), 2015, 31
  • [48] Real-Time Mobile Personalized Simulations of Impaired Colour Vision
    McAlpine, Rhouri
    Flatla, David R.
    ASSETS'16: PROCEEDINGS OF THE 18TH INTERNATIONAL ACM SIGACCESS CONFERENCE ON COMPUTERS AND ACCESSIBILITY, 2016, : 181 - 189
  • [49] Railway Fastener Inspection by Real-Time Machine Vision
    Aytekin, Caglar
    Rezaeitabar, Yousef
    Dogru, Sedat
    Ulusoy, Ilkay
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2015, 45 (07): : 1101 - 1107
  • [50] An Overview of Vision Substitution System for the Visually Impaired
    Motshoane, Kefentse
    Tu, Chunling
    Owolawi, Pius Adewale
    PROCEEDINGS OF 2017 3RD IEEE INTERNATIONAL CONFERENCE ON COMPUTER AND COMMUNICATIONS (ICCC), 2017, : 2802 - 2806
12345