PERCEPTFLOW: REAL-TIME ULTRAFAST DOPPLER IMAGE ENHANCEMENT USING DEEP CONVOLUTIONAL NEURAL NETWORK AND PERCEPTUAL LOSS

被引:1
|
作者
Blons, Matthieu [1 ,2 ]
Deffieux, Thomas [1 ,2 ]
Osmanski, Bruno -Felix [3 ]
Tanter, Mickael [1 ,2 ]
Berthon, Beatrice [1 ,2 ]
机构
[1] PSL Univ, Phys Med Paris, INSERM U1273, ESPCI Paris, Paris, France
[2] CNRS 8063, Paris, France
[3] Iconeus, Paris, France
来源
ULTRASOUND IN MEDICINE AND BIOLOGY | 2023年 / 49卷 / 01期
关键词
Doppler imaging; Deep learning; Convolutional neural network; Perceptual loss; Image enhancement;
D O I
10.1016/j.ultrasmedbio.2022.08.016
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Ultrafast ultrasound is an emerging imaging modality derived from standard medical ultrasound. It allows for a high spatial resolution of 100 mm and a temporal resolution in the millisecond range with techniques such as ultrafast Doppler imaging. Ultrafast Doppler imaging has become a priceless tool for neuroscience, especially for visualizing functional vascular structures and navigating the brain in real time. Yet, the quality of a Doppler image strongly depends on experimental conditions and is easily subject to artifacts and deterioration, especially with transcranial imaging, which often comes at the cost of higher noise and lower sensitivity to small blood vessels. A common solution to better visualize brain vasculature is either accumulating more information, integrating the image over several seconds or using standard filter-based enhancement techniques, which often over-smooth the image, thus failing both to preserve sharp details and to improve our perception of the vasculature. In this study we propose combining the standard Doppler accumulation process with a real-time enhancement strategy, based on deep-learning techniques, using perceptual loss (PerceptFlow). With our perceptual approach, we bypass the need for long integration times to enhance Doppler images. We applied and evaluated our proposed method on transcranial Doppler images of mouse brains, outperforming state-of-the-art filters. We found that, in comparison to standard filters such as the Gaussian filter (GF) and block-matching and 3-D filtering (BM3D), PerceptFlow was capable of reducing background noise with a significant increase in contrast and contrast-to-noise ratio, as well as better preserving details without compromising spatial resolution. (c) 2022 World Federation for Ultrasound in Medicine & Biology. All rights reserved.
引用
收藏
页码:225 / 236
页数:12
相关论文
共 50 条
  • [1] Real-time Detection of Multilabel Image Artifacts In an Ophthalmic Instrument Using a Convolutional Neural Network/Deep Neural Network Model
    Sarver, Edwin J.
    Hall, Max
    INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2021, 62 (08)
  • [2] Tiny Fusion: Tiny Deep Convolutional Neural Network for Real-time Image Fusion
    Wang, Jixiao
    Li, Yang
    Miao, Zhuang
    Wang, Jiabao
    Zhao, Xun
    2019 2ND IEEE INTERNATIONAL CONFERENCE ON INFORMATION COMMUNICATION AND SIGNAL PROCESSING (ICICSP), 2019, : 384 - 389
  • [3] A Convolutional Recurrent Neural Network for Real-Time Speech Enhancement
    Tan, Ke
    Wang, DeLiang
    19TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2018), VOLS 1-6: SPEECH RESEARCH FOR EMERGING MARKETS IN MULTILINGUAL SOCIETIES, 2018, : 3229 - 3233
  • [4] Real-time underwater image resolution enhancement using super-resolution with deep convolutional neural networks
    Mohammad Kazem Moghimi
    Farahnaz Mohanna
    Journal of Real-Time Image Processing, 2021, 18 : 1653 - 1667
  • [5] Real-time underwater image resolution enhancement using super-resolution with deep convolutional neural networks
    Moghimi, Mohammad Kazem
    Mohanna, Farahnaz
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2021, 18 (05) : 1653 - 1667
  • [6] Real-Time Facial Expression Recognition Using Deep Convolutional Neural Network
    Zeng, Yuwen
    Xiao, Nan
    Wang, Kaidi
    Yuan, Hang
    2019 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION (ICMA), 2019, : 1536 - 1541
  • [7] Road Image Enhancement and Real-Time Vehicle Detection at Night Based on Convolutional Neural Network
    Dong, Tao
    Engineering Intelligent Systems, 2024, 32 (02): : 169 - 178
  • [8] Real-time estimation of perceptual thresholds based on the electroencephalogram using a deep neural network
    van den Berg, Boudewijn
    Vanwinsen, L.
    Jansen, N.
    Buitenweg, Jan R.
    JOURNAL OF NEUROSCIENCE METHODS, 2022, 374
  • [9] Real-Time Speech Enhancement Based on Convolutional Recurrent Neural Network
    Girirajan, S.
    Pandian, A.
    INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2023, 35 (02): : 1987 - 2001
  • [10] A real-time hourly ozone prediction system using deep convolutional neural network
    Ebrahim Eslami
    Yunsoo Choi
    Yannic Lops
    Alqamah Sayeed
    Neural Computing and Applications, 2020, 32 : 8783 - 8797