Federated learning-powered visual object detection for safety monitoring

被引:3
|
作者
Liu, Yang [1 ]
Huang, Anbu [1 ]
Luo, Yun [2 ,3 ]
Huang, He [3 ]
Liu, Youzhi [1 ]
Chen, Yuanyuan [4 ]
Feng, Lican [3 ]
Chen, Tianjian [1 ]
Yu, Han [3 ,4 ,5 ]
Yang, Qiang [1 ,2 ]
机构
[1] WeBank, Dept AI, Shenzhen, Peoples R China
[2] Hong Kong Univ Sci & Technol, Dept Comp Sci & Engn, Hong Kong, Peoples R China
[3] Extreme Vis Ltd, Shenzhen, Peoples R China
[4] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore, Singapore
[5] Joint NTU WeBank Res Ctr FinTech, Singapore, Singapore
基金
新加坡国家研究基金会;
关键词
D O I
10.1609/aimag.v42i2.15095
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Visual object detection is an important artificial intelligence (AI) technique for safety monitoring applications. Current approaches for building visual object detection models require large and well-labeled dataset stored by a centralized entity. This not only poses privacy concerns under the General Data Protection Regulation (GDPR), but also incurs large transmission and storage overhead. Federated learning (FL) is a promising machine learning paradigm to address these challenges. In this paper, we report on FedVision-a machine learning engineering platform to support the development of federated learning powered computer vision applications-to bridge this important gap. The platform has been deployed through collaboration between WeBank and Extreme Vision to help customers develop computer vision-based safety monitoring solutions in smart city applications. Through actual usage, it has demonstrated significant efficiency improvement and cost reduction while fulfilling privacy-preservation requirements (e.g., reducing communication overhead for one company by 50 fold and saving close to 40,000RMB of network cost per annum). To the best of our knowledge, this is the first practical application of FL in computer vision-based tasks.
引用
收藏
页码:19 / 27
页数:9
相关论文
共 50 条
  • [21] Machine learning-powered antibiotics phenotypic drug discovery
    Sannah Zoffmann
    Maarten Vercruysse
    Fethallah Benmansour
    Andreas Maunz
    Luise Wolf
    Rita Blum Marti
    Tobias Heckel
    Haiyuan Ding
    Hoa Hue Truong
    Michael Prummer
    Roland Schmucki
    Clive S. Mason
    Kenneth Bradley
    Asha Ivy Jacob
    Christian Lerner
    Andrea Araujo del Rosario
    Mark Burcin
    Kurt E. Amrein
    Marco Prunotto
    Scientific Reports, 9
  • [22] Deep Learning-Powered Optical Microscopy for Steel Research
    Mikmekova, Sarka
    Zouhar, Martin
    Cermak, Jan
    Ambroz, Ondrej
    Jozefovic, Patrik
    Konvalina, Ivo
    Mikmekova, Eliska Materna
    Materna, Jiri
    MACHINE LEARNING AND KNOWLEDGE EXTRACTION, 2024, 6 (03): : 1579 - 1596
  • [23] Deep learning-powered visual inspection for metal surfaces - Impact of annotations on algorithms based on defect characteristics
    Dubey, Pallavi
    Miller, Seth
    Gunay, Elif Elcin
    Jackman, John
    Kremer, Gul E.
    Kremer, Paul A.
    ADVANCED ENGINEERING INFORMATICS, 2024, 62
  • [24] Deep learning-powered visual place recognition for enhanced mobile multimedia communication in autonomous transport systems
    Devi, E. M. Roopa
    Abirami, T.
    Dutta, Ashit Kumar
    Alsubai, Shtwai
    ALEXANDRIA ENGINEERING JOURNAL, 2024, 109 : 950 - 962
  • [25] AI- and Deep Learning-Powered Driver Drowsiness Detection Method Using Facial Analysis
    Delwar, Tahesin Samira
    Singh, Mangal
    Mukhopadhyay, Sayak
    Kumar, Akshay
    Parashar, Deepak
    Lee, Yangwon
    Rahman, Md Habibur
    Sejan, Mohammad Abrar Shakil
    Ryu, Jee Youl
    APPLIED SCIENCES-BASEL, 2025, 15 (03):
  • [26] Navigating Data Heterogeneity in Federated Learning: A Semi-Supervised Federated Object Detection
    Kim, Taehyeon
    Lin, Eric
    Lee, Junu
    Lau, Christian
    Mugunthan, Vaikkunth
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [27] Federated Learning with Infrastructure Resource Limitations in Vehicular Object Detection
    Chen, Yiyue
    Wang, Chianing
    Kim, Baekgyu
    2021 ACM/IEEE 6TH SYMPOSIUM ON EDGE COMPUTING (SEC 2021), 2021, : 366 - 370
  • [28] Capturing complex hand movements and object interactions using machine learning-powered stretchable smart textile gloves
    Tashakori, Arvin
    Jiang, Zenan
    Servati, Amir
    Soltanian, Saeid
    Narayana, Harishkumar
    Le, Katherine
    Nakayama, Caroline
    Yang, Chieh-ling
    Wang, Z. Jane
    Eng, Janice J.
    Servati, Peyman
    NATURE MACHINE INTELLIGENCE, 2024, 6 (01) : 106 - 118
  • [29] Capturing complex hand movements and object interactions using machine learning-powered stretchable smart textile gloves
    Arvin Tashakori
    Zenan Jiang
    Amir Servati
    Saeid Soltanian
    Harishkumar Narayana
    Katherine Le
    Caroline Nakayama
    Chieh-ling Yang
    Z. Jane Wang
    Janice J. Eng
    Peyman Servati
    Nature Machine Intelligence, 2024, 6 : 106 - 118
  • [30] A deep learning-powered intelligent microdroplet analysis workflow for in-situ monitoring and evaluation of a dynamic emulsion
    Liu, Jian
    Li, Muyang
    Cai, Jingwei
    Yao, Tuo
    Dang, Leping
    Rohani, Sohrab
    Gao, Zhenguo
    Gong, Junbo
    CHEMICAL ENGINEERING JOURNAL, 2024, 499