Fusing Attention Features and Contextual Information for Scene Recognition

被引:1
|
作者
Peng, Yuqing [1 ]
Liu, Xianzi [2 ]
Wang, Chenxi [1 ]
Xiao, Tengfei [1 ]
Li, Tiejun [3 ]
机构
[1] Hebei Univ Technol, Sch Artificial Intelligence, Tianjin 300401, Peoples R China
[2] China Shenhua Int Engn Co Ltd, Beijing 100007, Peoples R China
[3] Hebei Univ Technol, Sch Mech Engn, Tianjin 300401, Peoples R China
基金
中国国家自然科学基金;
关键词
Scene recognition; muti-scale attention; joint supervision; context information; CLASSIFICATION;
D O I
10.1142/S0218001422500148
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Aiming to obtain more discriminative features in scene images and overcome the impacts of intra-class differences and inter-class similarities, the paper proposes a scene recognition method that combines attention and context information. First, we introduce the attention mechanism and build a multi-scale attention model. Discriminative information considers salient objects and regions by means of channel attention and spatial attention. Besides, the central loss function joint supervision strategy is introduced to further reduce the misjudgment of intra-class differences. Second, a model based on multi-level context information is proposed to describe the positional relationship between objects, which can effectively alleviate the influence of the similarity of objects between classes. Finally, the two models are merged to give full play to the compatibility of features, so that the final feature representation not only focuses on the effective discriminant information, but also manifests the relative position relationship between significant objects. Extensive experiments have proved that the method in this paper effectively solves the problem of insufficient feature representation in scene recognition tasks, and improves the accuracy of scene recognition.
引用
收藏
页数:21
相关论文
共 50 条
  • [1] Fusing Handcrafted and Contextual Features for Human Activity Recognition
    Vernikos, Ioannis
    Mathe, Eirini
    Spyrou, Evaggelos
    Mitsou, Alexandros
    Giannakopoulos, Theodore
    Mylonas, Phivos
    2019 14TH INTERNATIONAL WORKSHOP ON SEMANTIC AND SOCIAL MEDIA ADAPTATION AND PERSONALIZATION (SMAP), 2019, : 36 - 41
  • [2] Fusing Object Semantics and Deep Appearance Features for Scene Recognition
    Sun, Ning
    Li, Wenli
    Liu, Jixin
    Han, Guang
    Wu, Cong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (06) : 1715 - 1728
  • [3] BioByGANS: biomedical named entity recognition by fusing contextual and syntactic features through graph attention network in node classification framework
    Zheng, Xiangwen
    Du, Haijian
    Luo, Xiaowei
    Tong, Fan
    Song, Wei
    Zhao, Dongsheng
    BMC BIOINFORMATICS, 2022, 23 (01)
  • [4] BioByGANS: biomedical named entity recognition by fusing contextual and syntactic features through graph attention network in node classification framework
    Xiangwen Zheng
    Haijian Du
    Xiaowei Luo
    Fan Tong
    Wei Song
    Dongsheng Zhao
    BMC Bioinformatics, 23
  • [5] A Framework for Facial Expression Recognition Combining Contextual Information and Attention Mechanism
    Chen, Jianzeng
    Chen, Ningning
    JOURNAL OF INFORMATION PROCESSING SYSTEMS, 2024, 20 (04): : 535 - 549
  • [6] Fusing local and global information for scene classification
    Jiang, Yue
    Chen, Jin
    Wang, Runsheng
    OPTICAL ENGINEERING, 2010, 49 (04)
  • [7] RSSGG_CS: Remote Sensing Image Scene Graph Generation by Fusing Contextual Information and Statistical Knowledge
    Lin, Zhiyuan
    Zhu, Feng
    Wang, Qun
    Kong, Yanzi
    Wang, Jianyu
    Huang, Liang
    Hao, Yingming
    REMOTE SENSING, 2022, 14 (13)
  • [8] Learning implicit sentiments in Alzheimer's disease recognition with contextual attention features
    Liu, Ning
    Yuan, Zhenming
    Chen, Yan
    Liu, Chuan
    Wang, Lingxing
    FRONTIERS IN AGING NEUROSCIENCE, 2023, 15
  • [9] The Ability to Use Contextual Information in Object and Scene Recognition in Patients with Mild Cognitive Impairment
    Wang, Yaqi
    Yang, Kai
    Fu, Pengrui
    Zheng, Xiaolei
    Yang, Hui
    Zhou, Qingbo
    Ma, Wen
    Wang, Ping
    JOURNAL OF ALZHEIMERS DISEASE, 2023, 95 (03) : 945 - 963
  • [10] Fusing Facial Features for Face Recognition
    Dargham, Jamal Ahmad
    Chekima, Ali
    Moung, Ervin Gubin
    INTERNATIONAL JOURNAL OF INTERACTIVE MULTIMEDIA AND ARTIFICIAL INTELLIGENCE, 2012, 1 (05): : 54 - 60