Automatic Hiding Method of Sensitive Targets in Remote Sensing Images Based on Transformer Structure

被引:0
|
作者
Li P. [1 ]
Bai W. [1 ,2 ]
机构
[1] School of Surveying and Mapping, Information Engineering University, Zhengzhou
[2] 61363 Troops, Xi'an
关键词
deep learning; remote sensing image; sensitive target hiding; synthetic data; Transformer structure;
D O I
10.13203/j.whugis20220219
中图分类号
学科分类号
摘要
Objective Decryption is the key to ensure the safe sharing of remote sensing resources. To solve the problems of incomplete target detection, unreliable complementary results, high resource consumption and difficulty of training in the traditional methods of sensitive target hiding in remote sensing images, an automatic hiding method of sensitive targets in remote sensing images is proposed based on the ability of Transformer structure to deal with global information. Methods Firstly, the optimized Cascade Mask R-CNN instance segmentation model with Swin Transformer as the backbone network is used to detect sensitive targets and generate mask regions. After improving the generalization capability of the model, RSMosaic (remote sense Mosaic), a data synthesis method to reduce the dependence on manually labeled data is designed. Secondly, the mask region is expanded by using the shadow detection model based on HSV(hue-saturation-value) space, and the MAE(masked autoencoders) model is introduced to achieve target background generation. Finally, the generated images are spliced with the original images to obtain the decrypted images. Results The sub-meter remote sensing images collected by Google Earth are used as test data, and the results show that this proposed method generates reliable hiding results while reducing dataset dependence and training resource consumption. Compared with the traditional method, the AP (average precision) values of bounding box and pixel mask are improved by 13.2% and 11.2% respectively in sensitive target instance segmentation, and the AP values can be improved by another 9.39% and 14.16% respectively after using RSMosaic, which is better than other repair models in terms of objective index and index variance in the field of image repair, especially in mean absolute error and maximum mean discrepancy indexes which are improved by more than 80%. It achieves the effect of automatic hiding of sensitive targets with reasonable structure and clear texture. Conclusions The proposed method reduces manpower, data and computing resources, and achieves better results in both subjective visual effects and objective indexes, which can provide technical support for real remote sensing image sharing. © 2022 Wuhan University. All rights reserved.
引用
收藏
页码:1287 / 1297
页数:10
相关论文
共 30 条
  • [1] Binbin Li, Research on Decipherment Model and Algorithm of Sensitive Target for Digital Image[D], (2015)
  • [2] Criminisi A,, Perez P,, Toyama K., Region Filling and Object Removal by Exemplar-Based Image Inpainting[J], IEEE Transactions on Image Processing, 13, 9, pp. 1200-1212, (2004)
  • [3] Pengjie Lu, Dalu Xu, Fu Ren, Et al., Auto-Detection and Hiding of Sensitive Targets in Emergency Mapping Based on Remote Sensing Data[J], Geomatics and Information Science of Wuhan University, 45, 8, pp. 1263-1272, (2020)
  • [4] [4] He K M,Gkioxari G,Dollár P,et al. Mask R-CNN[C], IEEE International Conference on Computer Vision, (2017)
  • [5] Yu J H, Lin Z, Et al., Generative Image Inpainting with Contextual Attention[C], IEEE/ CVF Conference on Computer Vision and Pattern Recognition, (2018)
  • [6] Goodfellow I J,, Pouget-Abadie J,, Mirza M,, Et al., Generative Adversarial Networks[J], (2014)
  • [7] Xianyi Cheng, Lu Xie, Jianxin Zhu, Et al., Review of Generative Adversarial Network[J], Computer Science, 46, 3, pp. 74-81, (2019)
  • [8] Vaswani A, Shazeer N,, Parmar N,, Et al., Attention is all You Need[J], (2017)
  • [9] Dosovitskiy A,, Beyer L,, Kolesnikov A,, Et al., An Image is Worth 16×16 Words:Transformers for Image Recognition at Scale[J]
  • [10] Liu Z, Lin Y T, Et al., Swin Transformer:Hierarchical Vision Transformer Using Shifted Windows[C], IEEE/CVF International Conference on Computer Vision (ICCV), (2021)