A deep learning-powered intelligent microdroplet analysis workflow for in-situ monitoring and evaluation of a dynamic emulsion

被引:1
|
作者
Liu, Jian [1 ]
Li, Muyang [1 ]
Cai, Jingwei [1 ]
Yao, Tuo [1 ]
Dang, Leping [1 ]
Rohani, Sohrab [2 ]
Gao, Zhenguo [1 ,3 ]
Gong, Junbo [1 ,3 ]
机构
[1] Tianjin Univ, Coinnovat Ctr Chem & Chem Engn Tianjin, Sch Chem Engn & Technol, State Key Lab Chem Engn, Tianjin 300072, Peoples R China
[2] Univ Western Ontario, Dept Chem & Biochem Engn, London, ON N6A 5B9, Canada
[3] Haihe Lab Sustainable Chem Transformat, Tianjin 300192, Peoples R China
基金
中国国家自然科学基金;
关键词
Microdroplet segmentation; Deep learning; Mask R-CNN; Emulsion evaluation; Shape reconstruction; Data mining; SIZE DISTRIBUTIONS; DROPLET; MODEL;
D O I
10.1016/j.cej.2024.155927
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Accurately determining microdroplet size and uniformity in dispersed phase systems is key for assessing emulsion stability, and essential for quality monitoring and control of emulsion products. Microscopic imaging probes have provided intuitive and advanced insights for characterizing particle microscopic morphology and dispersion in multiphase flows. However, wide size distributions, edge-cutting, overlapping, and high-density target droplets can compromise the image processing accuracy, thereby affecting the precise assessment of emulsion status. In this study, we present a deep learning-based intelligent workflow for microdroplet characterization using an in-situ high-speed particle imaging probe combined with advanced image processing techniques. With the assistance of progressive automatic annotation, a droplet image database was constructed for training the Mask R-CNN model. By incorporating image patching and supervised data augmentation strategies, our well-trained model with accuracy of 95.5% can precisely detect, localize, and segment microscale droplets with various patterns. Additionally, the shape reconstruction module visualizes true shapes of overlapping and edge-cutting droplets, facilitating precise quantification of droplet size information. To validate the feasibility and generalizability of the proposed workflow, we obtained sufficient droplet images through offline sampling during emulsion processes while employing back and front illumination for in-situ monitoring. The automated method achieves precise droplet detection and size measurement, demonstrating its immense potential in online monitoring, evaluation, and control of emulsion quality.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Intelligent Sound Monitoring and Identification System Combining Triboelectric Nanogenerator-Based Self-Powered Sensor with Deep Learning Technique
    Yao, Hongbo
    Wang, Zhixin
    Wu, Yonghui
    Zhang, Yuanzheng
    Miao, Kexin
    Cui, Ming
    Ao, Tianyong
    Zhang, Jiawei
    Ban, Dayan
    Zheng, Haiwu
    ADVANCED FUNCTIONAL MATERIALS, 2022, 32 (15)
  • [32] Real-time in-situ thermal monitoring system and defect detection using deep learning applied to additive manufacturing
    Rhim, Safouene
    Albahloul, Hala
    Roua, Christophe
    MATERIAL FORMING, ESAFORM 2024, 2024, 41 : 380 - 389
  • [33] Surface quality prediction in-situ monitoring system: a deep transfer learning-based regression approach with audible signal
    Zhu, Yaoxuan
    Rashid, Amir
    Osterlind, Tomas
    Archenti, Andreas
    MANUFACTURING LETTERS, 2024, 41 : 1290 - 1299
  • [34] Real-Time Intelligent Healthcare Monitoring and Diagnosis System Through Deep Learning and Segmented Analysis
    Panganiban, Edward B.
    Chung, Wen-Yaw
    Tai, Wei-Chieh
    Paglinawan, Arnold C.
    Lai, Jheng-Siang
    Cheng, Ren-Wei
    Chang, Ming-Kai
    Chang, Po-Hsuan
    FUTURE TRENDS IN BIOMEDICAL AND HEALTH INFORMATICS AND CYBERSECURITY IN MEDICAL DEVICES, ICBHI 2019, 2020, 74 : 15 - 25
  • [35] Intelligent Evaluation and Dynamic Prediction of Oysters Freshness with Electronic Nose Non-Destructive Monitoring and Machine Learning
    Wang, Baichuan
    Li, Yueyue
    Liu, Kang
    Wei, Guangfen
    He, Aixiang
    Kong, Weifu
    Zhang, Xiaoshuan
    BIOSENSORS-BASEL, 2024, 14 (10):
  • [36] Construction and characteristic analysis of in-situ combustion production dynamic evaluation equation based on seepage difference of zones
    Yuan, Shibao
    Li, Lehong
    Wang, Boyi
    Li, Tianyue
    Yang, Fengxiang
    Wang, Xuan
    Jiang, Haiyan
    PETROLEUM SCIENCE AND TECHNOLOGY, 2025,
  • [37] A deep learning-based model for defect detection in laser-powder bed fusion using in-situ thermographic monitoring
    Hermann Baumgartl
    Josef Tomas
    Ricardo Buettner
    Markus Merkel
    Progress in Additive Manufacturing, 2020, 5 : 277 - 285
  • [38] A deep learning-based model for defect detection in laser-powder bed fusion using in-situ thermographic monitoring
    Baumgartl, Hermann
    Tomas, Josef
    Buettner, Ricardo
    Merkel, Markus
    PROGRESS IN ADDITIVE MANUFACTURING, 2020, 5 (03) : 277 - 285
  • [39] Automatically Designing Network-Based Deep Transfer Learning Architectures Based on Genetic Algorithm for In-Situ Tool Condition Monitoring
    Liu, Yuekai
    Yu, Yaoxiang
    Guo, Liang
    Gao, Hongli
    Tan, Yongwen
    IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2022, 69 (09) : 9483 - 9493
  • [40] Deep learning based real-time and in-situ monitoring of weld penetration: Where we are and what are needed revolutionary solutions?
    Yu, Rui
    Cao, Yue
    Chen, Heping
    Ye, Qiang
    Zhang, YuMing
    JOURNAL OF MANUFACTURING PROCESSES, 2023, 93 : 15 - 46