Long-Range Feature Propagating for Natural Image Matting

被引:18
|
作者
Liu, Qinglin [1 ]
Xie, Haozhe [1 ]
Zhang, Shengping [1 ]
Zhong, Bineng [2 ]
Ji, Rongrong [3 ]
机构
[1] Harbin Inst Technol, Harbin, Peoples R China
[2] Guangxi Normal Univ, Guilin, Peoples R China
[3] Xiamen Univ, Xiamen, Peoples R China
基金
中国国家自然科学基金;
关键词
Image matting; Neural network; Feature propagation;
D O I
10.1145/3474085.3475203
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Natural image matting estimates the alpha values of unknown regions in the trimap. Recently, deep learning based methods propagate the alpha values from the known regions to unknown regions according to the similarity between them. However, we find that more than 50% pixels in the unknown regions cannot be correlated to pixels in known regions due to the limitation of small effective reception fields of common convolutional neural networks, which leads to inaccurate estimation when the pixels in the unknown regions cannot be inferred only with pixels in the reception fields. To solve this problem, we propose Long-Range Feature Propagating Network (LFPNet), which learns the long-range context features outside the reception fields for alpha matte estimation. Specifically, we first design the propagating module which extracts the context features from the downsampled image. Then, we present Center-Surround Pyramid Pooling (CSPP) that explicitly propagates the context features from the surrounding context image patch to the inner center image patch. Finally, we use the matting module which takes the image, trimap and context features to estimate the alpha matte. Experimental results demonstrate that the proposed method performs favorably against the state-of-the-art methods on the AlphaMatting and Adobe Image Matting datasets.
引用
收藏
页码:526 / 534
页数:9
相关论文
共 50 条
  • [21] Natural Image Matting with Total Variation Regularisation
    Tierney, Stephen
    Gao, Junbin
    2012 INTERNATIONAL CONFERENCE ON DIGITAL IMAGE COMPUTING TECHNIQUES AND APPLICATIONS (DICTA), 2012,
  • [22] Natural Image Matting with Attended Global Context
    Yi-Yi Zhang
    Li Niu
    Yasushi Makihara
    Jian-Fu Zhang
    Wei-Jie Zhao
    Yasushi Yagi
    Li-Qing Zhang
    Journal of Computer Science and Technology, 2023, 38 : 659 - 673
  • [23] New Appearance Models for Natural Image Matting
    Singaraju, Dheeraj
    Rother, Carsten
    Rhemann, Christoph
    CVPR: 2009 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOLS 1-4, 2009, : 659 - +
  • [24] Color subspace exploring for natural image matting
    Kong, Yating
    Li, Jide
    Hu, Liangpeng
    Li, Xiaoqiang
    IET IMAGE PROCESSING, 2024, 18 (09) : 2244 - 2256
  • [25] Tensorial Evolutionary Optimization for Natural Image Matting
    Lei, Si-Chao
    Gong, Yue-Jiao
    Xiao, Xiao-Lin
    Zhou, Yi-Cong
    Zhang, Jun
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (07)
  • [26] Local learning approach for natural image matting
    Peng, Hong-Jing
    Chen, Song-Can
    Zhang, Dao-Qiang
    Ruan Jian Xue Bao/Journal of Software, 2009, 20 (04): : 834 - 844
  • [27] Natural Image Matting Using HSI Framework
    Khandelwal, Vineet
    Gupta, Abhinav
    Kashyap, Manish
    Gandhi, Hitesh
    Dhawan, Aishwar
    2009 2ND IEEE INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND INFORMATION TECHNOLOGY, VOL 2, 2009, : 141 - 144
  • [28] Natural Image Matting with Attended Global Context
    Zhang, Yi-Yi
    Niu, Li
    Makihara, Yasushi
    Zhang, Jian-Fu
    Zhao, Wei-Jie
    Yagi, Yasushi
    Zhang, Li-Qing
    JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2023, 38 (03) : 659 - 673
  • [29] NON-PARAMETRIC NATURAL IMAGE MATTING
    Sarim, Muhammad
    Hilton, Adrian
    Guillemaut, Jean-Yves
    Kim, Hansung
    2009 16TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-6, 2009, : 3213 - 3216
  • [30] Natural image matting based on neighbor embedding
    Won, Kwang Hee
    Park, Soon-Yong
    Jung, Soon Ki
    COMPUTER VISION/COMPUTER GRAPHICS COLLABORATION TECHNIQUES, 2007, 4418 : 449 - +