REAL-TIME ENHANCEMENT OF IMAGE AND VIDEO SALIENCY USING SEMANTIC DEPTH OF FIELD

被引:0
|
作者
Su, Zhaolin [1 ]
Takahashi, Shigeo [1 ]
机构
[1] Univ Tokyo, Grad Sch Frontier Sci, Tokyo, Japan
关键词
Visual attention; Attention guidance; Saliency maps; Importance maps; Semantic depth of field; VISUAL-ATTENTION;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a method for automatically directing viewers' visual attention to important regions of images and videos in low-level vision. Inspired by the modern model of visual attention, the importance map of an input scene is automatically calculated by the combination of low-level features such as intensity and color, which are extracted using spatial filters in different spatial frequencies, together with a set of temporal features extracted using a temporal filter in case of dynamic scenes. A variable-kernel-convolution based on the importance map is then performed on the input scene, in order to make semantic depth of field effects in a way that important regions remain focused while others are blurred. The pipeline of our method is efficient enough to be executed in real time on modem low-end machines, and the associated experiment demonstrates that the proposed system can be complementary to the human visual system.
引用
收藏
页码:370 / 375
页数:6
相关论文
共 50 条
  • [21] Real-time Image Semantic Segmentation Networks with Residual Depth-wise Separable Blocks
    Van-Viet Doan
    Duy-Hung Nguyen
    Quoc-Long Tran
    Do-Van Nguyen
    Thanh-Ha Le
    2018 JOINT 10TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING AND INTELLIGENT SYSTEMS (SCIS) AND 19TH INTERNATIONAL SYMPOSIUM ON ADVANCED INTELLIGENT SYSTEMS (ISIS), 2018, : 174 - 179
  • [22] Real-time Controllable Denoising for Image and Video
    Zhang, Zhaoyang
    Jiang, Yitong
    Shao, Wenqi
    Wang, Xiaogang
    Luo, Ping
    Lin, Kaimo
    Gu, Jinwei
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 14028 - 14038
  • [23] Saliency-Driven Real-Time Video-to-Tactile Translation
    Kim, Myongchan
    Lee, Sungkil
    Choi, Seungmoon
    IEEE TRANSACTIONS ON HAPTICS, 2014, 7 (03) : 394 - 404
  • [24] Guest editorial: special issue on algorithms and architectures for real-time image and video enhancement
    Sergio Saponara
    Giovanni Ramponi
    Stefano Marsi
    Gerard de Haan
    Erwin Bellers
    Journal of Real-Time Image Processing, 2013, 8 : 1 - 3
  • [25] Guest editorial: special issue on algorithms and architectures for real-time image and video enhancement
    Saponara, Sergio
    Ramponi, Giovanni
    Marsi, Stefano
    de Haan, Gerard
    Bellers, Erwin
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2013, 8 (01) : 1 - 3
  • [26] Real-time iterative framework of regularized image restoration and its application to video enhancement
    Kim, S
    Shin, J
    Paik, J
    REAL-TIME IMAGING, 2003, 9 (01) : 61 - 72
  • [27] Real-time extended depth of field microscopy
    Botcherby, Edward J.
    Booth, Martin J.
    Juskaitis, Rimas
    Wilson, Tony
    OPTICS EXPRESS, 2008, 16 (26) : 21843 - 21848
  • [28] Importance ordering for real-time depth of field
    Fearing, P
    IMAGE ANALYSIS APPLICATIONS AND COMPUTER GRAPHICS, 1995, 1024 : 372 - 380
  • [29] REAL-TIME IMAGE-ENHANCEMENT TECHNIQUES
    KETCHAM, DJ
    WEBER, JW
    LOWE, RW
    JOURNAL OF THE OPTICAL SOCIETY OF AMERICA, 1976, 66 (02) : 171 - 171
  • [30] REAL-TIME DIGITAL IMAGE-ENHANCEMENT
    WOODS, RE
    GONZALEZ, RC
    PROCEEDINGS OF THE IEEE, 1981, 69 (05) : 643 - 654