Saliency Tree: A Novel Saliency Detection Framework

被引:217
|
作者
Liu, Zhi [1 ,2 ]
Zou, Wenbin [3 ,4 ]
Le Meur, Olivier [5 ]
机构
[1] Shanghai Univ, Sch Commun & Informat Engn, Shanghai 200444, Peoples R China
[2] Inst Rech Informat & Syst Aleatoires, F-35042 Rennes, France
[3] Shenzhen Univ, Coll Informat Engn, Shenzhen 518060, Peoples R China
[4] European Univ Brittany, Natl Inst Appl Sci Rennes, F-35708 Rennes, France
[5] Univ Rennes 1, F-35042 Rennes, France
基金
中国国家自然科学基金;
关键词
Saliency tree; saliency detection; saliency model; saliency map; regional saliency measure; region merging; salient node selection; VISUAL-ATTENTION; OBJECT DETECTION; MODEL; IMAGE; SEGMENTATION; MAXIMIZATION; COLOR; VIDEO;
D O I
10.1109/TIP.2014.2307434
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a novel saliency detection framework termed as saliency tree. For effective saliency measurement, the original image is first simplified using adaptive color quantization and region segmentation to partition the image into a set of primitive regions. Then, three measures, i.e., global contrast, spatial sparsity, and object prior are integrated with regional similarities to generate the initial regional saliency for each primitive region. Next, a saliency-directed region merging approach with dynamic scale control scheme is proposed to generate the saliency tree, in which each leaf node represents a primitive region and each non-leaf node represents a non-primitive region generated during the region merging process. Finally, by exploiting a regional center-surround scheme based node selection criterion, a systematic saliency tree analysis including salient node selection, regional saliency adjustment and selection is performed to obtain final regional saliency measures and to derive the high-quality pixel-wise saliency map. Extensive experimental results on five datasets with pixel-wise ground truths demonstrate that the proposed saliency tree model consistently outperforms the state-of-the-art saliency models.
引用
收藏
页码:1937 / 1952
页数:16
相关论文
共 50 条
  • [21] Hierarchical saliency: A new salient target detection framework
    Xuezhuan Zhao
    Bin Chen
    Lishen Pei
    Tao Li
    Mingxia Li
    International Journal of Control, Automation and Systems, 2016, 14 : 301 - 311
  • [22] Saliency detection framework via linear neighbourhood propagation
    Zhou, Jingbo
    Gao, Shangbing
    Yan, Yunyang
    Jin, Zhong
    IET IMAGE PROCESSING, 2014, 8 (12) : 804 - 814
  • [23] Hierarchical Saliency: A New Salient Target Detection Framework
    Zhao, Xuezhuan
    Chen, Bin
    Pei, Lishen
    Li, Tao
    Li, Mingxia
    INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2016, 14 (01) : 301 - 311
  • [24] Saliency as Evidence: Event Detection with Trigger Saliency Attribution
    Liu, Jian
    Chen, Yufeng
    Xu, Jinan
    PROCEEDINGS OF THE 60TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022), VOL 1: (LONG PAPERS), 2022, : 4573 - 4585
  • [25] Video Saliency Detection Using Motion Saliency Filter
    Luo, Lei
    Jiang, Rongxin
    Tian, Xiang
    Chen, Yaowu
    2013 3RD INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND NETWORK TECHNOLOGY (ICCSNT), 2013, : 1045 - 1049
  • [26] Saliency threshold: a novel saliency detection model using Ising's theory on Ferromagnetism (STIF)
    Singh, Navjot
    MULTIMEDIA SYSTEMS, 2020, 26 (04) : 397 - 411
  • [27] Saliency threshold: a novel saliency detection model using Ising’s theory on Ferromagnetism (STIF)
    Navjot Singh
    Multimedia Systems, 2020, 26 : 397 - 411
  • [28] Saliency and Object Detection
    Kong, Phutphalla
    Mancas, Matei
    Kheang, Seng
    Gosselin, Bernard
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE (ICPRAI 2018), 2018, : 523 - 528
  • [29] Hierarchical Saliency Detection
    Yan, Qiong
    Xu, Li
    Shi, Jianping
    Jia, Jiaya
    2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, : 1155 - 1162
  • [30] An Experimental Analysis of Saliency Detection with Respect to Three Saliency Levels
    Furnari, Antonino
    Farinella, Giovanni Maria
    Battiato, Sebastiano
    COMPUTER VISION - ECCV 2014 WORKSHOPS, PT III, 2015, 8927 : 806 - 821