An Image Fusion Method Combining the Advantages of Dual-Mode Optical Imaging in Endoscopy

被引:0
|
作者
Zhang, Shipeng [1 ]
Fu, Ye [2 ]
Zhang, Xinran [1 ]
Ma, Longfei [1 ]
Zhang, Hui [1 ]
Xie, Tianyu [2 ]
Zhao, Zhe [3 ,4 ]
Liao, Hongen [1 ]
机构
[1] Tsinghua Univ, Sch Med, Dept Biomed Engn, 30Shuangqing Rd, Beijing, Peoples R China
[2] Peking Univ, Dept Biomed Engn, Coll Future Technol, Beijing, Peoples R China
[3] Beijing Tsinghua Changgung Hosp, Beijing, Peoples R China
[4] Tsinghua Univ, Sch Clin Med, Beijing, Peoples R China
来源
12TH ASIAN-PACIFIC CONFERENCE ON MEDICAL AND BIOLOGICAL ENGINEERING, VOL 2, APCMBE 2023 | 2024年 / 104卷
基金
中国国家自然科学基金;
关键词
Endoscopy; Dual-mode optical imaging; Image fusion; PMGI;
D O I
10.1007/978-3-031-51485-2_13
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, endoscopic imaging technology has developed rapidly. Dual-mode optical imaging (DMOI) technology in endoscopy allows for rapid imaging of living tissue at the same position. It includes white light imaging (WLI) and compound band imaging (CBI), with each mode offering complementary advantages. WLI is the most commonly used mode in endoscopy. CBI is a virtual optical staining technique that highlights the small vascular structures of the gastrointestinal mucosa. It is essential to fuse their features to improve the image quality of endoscopy. This paper utilizes an image fusion network based on proportional maintenance of gradient and intensity for image fusion. A volunteer experiment was conducted in this study. The oral images were taken for the training and testing of the fusion network, and the results were obtained. We objectively evaluated the quality of the fused images and compared them with the WLI images. The results show that the fused images have natural color and rich details, and the image quality is significantly improved. This study is the first to propose the image fusion of DMOI in endoscopy. Our approach combines the strengths of both source images, which can assist medical professionals in making more precise diagnoses during clinical examinations. We think it has important significance for improving the detection rate of early lesions.
引用
收藏
页码:106 / 113
页数:8
相关论文
共 50 条
  • [31] Advancing fluorescence imaging with dual-mode AIE nanoparticles
    Cai, Qiang
    Musiol, Robert
    Shubhra, Quazi T. H.
    CHEM, 2024, 10 (02):
  • [32] Study on Judgment Method of Combustion Mode on dual-mode Scramjet
    Chen, Q.
    Chen, L. H.
    Gu, H. B.
    Zhang, X. Y.
    Wang, P.
    7TH ASIAN-PACIFIC CONFERENCE ON AEROSPACE TECHNOLOGY AND SCIENCE, APCATS 2013, 2013, 67 : 147 - 154
  • [33] Dual-mode adaptive-SVD ghost imaging
    Wang, Dajing
    Liu, Baolei
    Song, Jiaqi
    Wang, Yao
    Shan, Xuchen
    Zhong, Xiaolan
    Wang, Fan
    OPTICS EXPRESS, 2023, 31 (09) : 14225 - 14239
  • [34] Integral imaging system using a dual-mode technique
    Kim, Youngmin
    Park, Soon-gi
    Min, Sung-Wook
    Lee, Byoungho
    APPLIED OPTICS, 2009, 48 (34) : H71 - H76
  • [35] A Dual-Mode Imaging Catheter for Intravascular Ultrasound Application
    Hong, Jiehan
    Su, Min
    Yu, Yanyan
    Zhang, Zhiqiang
    Liu, Rong
    Huang, Yaocai
    Mu, Peitian
    Zheng, Hairong
    Qiu, Weibao
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (03) : 657 - 663
  • [36] Rational design of a dual-mode optical and chemical prodrug
    McCoy, Colin P.
    Rooney, Clare
    Jones, David S.
    Gorman, Sean P.
    Nieuwenhuyzen, Mark
    PHARMACEUTICAL RESEARCH, 2007, 24 (01) : 194 - 200
  • [37] Optical design of the IR/ladar dual-mode seeker
    Zuo, Bao-Jun
    Kuang, Yao-Wu
    Hongwai yu Jiguang Gongcheng/Infrared and Laser Engineering, 2009, 38 (03): : 495 - 499
  • [38] MEASUREMENT OF INTERMODAL DELAY IN A DUAL-MODE OPTICAL FIBER
    UTTAM, D
    ELECTRONICS LETTERS, 1985, 21 (22) : 1031 - 1033
  • [39] Dual-mode micromirrors for optical phased array applications
    Krishnamoorthy, U
    Li, K
    Yu, K
    Lee, D
    Heritage, JP
    Solgaard, O
    SENSORS AND ACTUATORS A-PHYSICAL, 2002, 97-8 : 21 - 26
  • [40] Rational Design of a Dual-Mode Optical and Chemical Prodrug
    Colin P. McCoy
    Clare Rooney
    David S. Jones
    Sean P. Gorman
    Mark Nieuwenhuyzen
    Pharmaceutical Research, 2007, 24 : 194 - 200