An Image Fusion Method Combining the Advantages of Dual-Mode Optical Imaging in Endoscopy

被引:0
|
作者
Zhang, Shipeng [1 ]
Fu, Ye [2 ]
Zhang, Xinran [1 ]
Ma, Longfei [1 ]
Zhang, Hui [1 ]
Xie, Tianyu [2 ]
Zhao, Zhe [3 ,4 ]
Liao, Hongen [1 ]
机构
[1] Tsinghua Univ, Sch Med, Dept Biomed Engn, 30Shuangqing Rd, Beijing, Peoples R China
[2] Peking Univ, Dept Biomed Engn, Coll Future Technol, Beijing, Peoples R China
[3] Beijing Tsinghua Changgung Hosp, Beijing, Peoples R China
[4] Tsinghua Univ, Sch Clin Med, Beijing, Peoples R China
来源
12TH ASIAN-PACIFIC CONFERENCE ON MEDICAL AND BIOLOGICAL ENGINEERING, VOL 2, APCMBE 2023 | 2024年 / 104卷
基金
中国国家自然科学基金;
关键词
Endoscopy; Dual-mode optical imaging; Image fusion; PMGI;
D O I
10.1007/978-3-031-51485-2_13
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, endoscopic imaging technology has developed rapidly. Dual-mode optical imaging (DMOI) technology in endoscopy allows for rapid imaging of living tissue at the same position. It includes white light imaging (WLI) and compound band imaging (CBI), with each mode offering complementary advantages. WLI is the most commonly used mode in endoscopy. CBI is a virtual optical staining technique that highlights the small vascular structures of the gastrointestinal mucosa. It is essential to fuse their features to improve the image quality of endoscopy. This paper utilizes an image fusion network based on proportional maintenance of gradient and intensity for image fusion. A volunteer experiment was conducted in this study. The oral images were taken for the training and testing of the fusion network, and the results were obtained. We objectively evaluated the quality of the fused images and compared them with the WLI images. The results show that the fused images have natural color and rich details, and the image quality is significantly improved. This study is the first to propose the image fusion of DMOI in endoscopy. Our approach combines the strengths of both source images, which can assist medical professionals in making more precise diagnoses during clinical examinations. We think it has important significance for improving the detection rate of early lesions.
引用
收藏
页码:106 / 113
页数:8
相关论文
共 50 条
  • [41] The consideration of the optical design in the dual-mode transflective LCDs
    Hsieh, C. H.
    Shai, Y. A.
    Su, P. J.
    Chang, K. H.
    Hsiao, C. C.
    Shiu, J. W.
    Fuh, S. Y.
    Cheng, W. Y.
    Liao, Y. C.
    Yang, J. C.
    Lo, K. L.
    Lee, D. W.
    Lee, K. C.
    Chang, Y. P.
    IDW '06: PROCEEDINGS OF THE 13TH INTERNATIONAL DISPLAY WORKSHOPS, VOLS 1-3, 2006, : 125 - 128
  • [42] Design of dual-mode optical fibres for the FTTH applications
    Chen, Ming-Yang
    Li, Yu-Rong
    Zhang, Yin
    Zhu, Yuan-Feng
    Zhang, Yong-Kang
    Zhou, Jun
    JOURNAL OF OPTICS, 2011, 13 (01)
  • [43] Dual-mode micromirrors for optical phased array applications
    Krishnamoorthy, U
    Li, K
    Yu, K
    Lee, D
    Heritage, JP
    Solgaard, O
    TRANSDUCERS '01: EUROSENSORS XV, DIGEST OF TECHNICAL PAPERS, VOLS 1 AND 2, 2001, : 1294 - 1297
  • [44] DUAL-MODE OPTICAL FIBERS WITH ZERO INTERMODAL DISPERSION
    CVIJETIC, MM
    OPTICAL AND QUANTUM ELECTRONICS, 1984, 16 (04) : 307 - 317
  • [45] DUAL-MODE OPTICAL-FIBRE INTERFEROMETRIC SENSOR
    MCMILLAN, JL
    ROBERTSON, SC
    ELECTRONICS LETTERS, 1984, 20 (03) : 136 - 137
  • [46] Dual-Mode Comb Plasmonic Optical Fiber Sensing
    Villatoro, Efrain
    Loyez, Mederic
    Villatoro, Joel
    Caucheteur, Christophe
    Albert, Jacques
    ACS SENSORS, 2024, 9 (06): : 3027 - 3036
  • [47] Optical Fiber Mode Filters in the Dual-Mode Fiber Transmission Systems
    Tian, Zhaobing
    Chen, Chen
    Plant, David V.
    2011 IEEE PHOTONICS CONFERENCE (PHO), 2011, : 234 - 235
  • [48] Data fusion in dual-mode tomography for imaging oil-gas two-phase flow
    Zhang, Ronghua
    Wang, Qi
    Wang, Huaxiang
    Zhang, Mu
    Li, Hongli
    FLOW MEASUREMENT AND INSTRUMENTATION, 2014, 37 : 1 - 11
  • [49] Radiosynthesis of SO2F-Functionalized Optical Imaging Probes for Application as a Dual-mode Imaging Agent
    Kim, Seon Yoo
    Jeon, Min Ho
    Son, Jeongmin
    Jeong, Jinsil
    Chun, Joong-Hyun
    JOURNAL OF NUCLEAR MEDICINE, 2024, 65
  • [50] The Dual-Mode Imaging of Nanogold-Labeled Cells by Photoacoustic Microscopy and Fluorescence Optical Microscopy
    Zhang, Yu
    Tang, Zhilie
    Wu, Yongbo
    Xue, Yueju
    Jia, Jinliang
    TECHNOLOGY IN CANCER RESEARCH & TREATMENT, 2018, 17