Progressive scene text erasing with self-supervision

被引:4
|
作者
Du, Xiangcheng [1 ]
Zhou, Zhao [1 ]
Zheng, Yingbin [2 ]
Wu, Xingjiao [1 ]
Ma, Tianlong [1 ]
Jin, Cheng [1 ]
机构
[1] Fudan Univ, Sch Comp Sci, Shanghai, Peoples R China
[2] Videt Lab, Shanghai, Peoples R China
关键词
Scene text erasing; Progressive strategy; Self-supervision;
D O I
10.1016/j.cviu.2023.103712
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Scene text erasing seeks to erase text contents from scene images and current state-of-the-art text erasing models are trained on large-scale synthetic data. Although data synthetic engines can provide vast amounts of annotated training samples, there are differences between synthetic and real-world data. In this paper, we employ self-supervision for feature representation on unlabeled real-world scene text images. A novel pretext task is designed to keep consistent among text stroke masks of image variants. We design the Progressive Erasing Network in order to remove residual texts. The scene text is erased progressively by leveraging the intermediate generated results which provide the foundation for subsequent higher quality results. Experiments show that our method significantly improves the generalization of the text erasing task and achieves state-of-the-art performance on public benchmarks.
引用
收藏
页数:10
相关论文
共 50 条
  • [32] Stereo Matching by Self-supervision of Multiscopic Vision
    Yuan, Weihao
    Zhang, Yazhan
    Wu, Bingkun
    Zhu, Siyu
    Tan, Ping
    Wang, Michael Yu
    Chen, Qifeng
    2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, : 5702 - 5709
  • [33] Universal Domain Adaptation through Self-Supervision
    Saito, Kuniaki
    Kim, Donghyun
    Sclaroff, Stan
    Saenko, Kate
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [34] SEMI-SUPERVISED DOMAIN ADAPTATION FOR ACOUSTIC SCENE CLASSIFICATION BY MINIMAX ENTROPY AND SELF-SUPERVISION APPROACHES
    Takahashi, Yukiko
    Takamuku, Sawa
    Imoto, Keisuke
    Natori, Naotake
    2022 INTERNATIONAL WORKSHOP ON ACOUSTIC SIGNAL ENHANCEMENT (IWAENC 2022), 2022,
  • [35] Video-based spatio-temporal scene graph generation with efficient self-supervision tasks
    Chen, Lianggangxu
    Cai, Yiqing
    Lu, Changhong
    Wang, Changbo
    He, Gaoqi
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (25) : 38947 - 38966
  • [36] GROUP THERAPY - EFFECTIVE METHOD OF SELF-SUPERVISION
    COHEN, AI
    SMALL GROUP BEHAVIOR, 1973, 4 (01): : 69 - 80
  • [37] Self-supervision, normativity and the free energy principle
    Jakob Hohwy
    Synthese, 2021, 199 : 29 - 53
  • [38] Sense and Learn: Self-supervision for omnipresent sensors
    Saeed, Aaqib
    Ungureanu, Victor
    Gfeller, Beat
    Machine Learning with Applications, 2021, 6
  • [39] Learning to Remove Rain in Video With Self-Supervision
    Yang, Wenhan
    Tan, Robby T.
    Wang, Shiqi
    Kot, Alex C.
    Liu, Jiaying
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (03) : 1378 - 1396
  • [40] SELF-SUPERVISION BY PREDICTION FOR OBJECT DISCOVERY IN VIDEOS
    Besbinar, Beril
    Frossard, Pascal
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 1509 - 1513