Weakly supervised semantic segmentation and optimization algorithm based on multi-scale feature model

In order to improve the accuracy of weakly-supervised semantic segmentation method, a segmentation and optimization algorithm that combines multi-scale feature was proposed. The new algorithm firstly constructs a multi-scale feature model based on transfer learning algorithm. In addition, a new classifier was introduced for category prediction to reduce the failure of segmentation due to the prediction of target class information errors. Then the designed multi-scale model was fused with the original transfer learning model by different weights to enhance the generalization performance of the model. Finally, the predictions class credibility was added to adjust the credibility of the corresponding class of pixels in the segmentation map, avoiding false positive segmentation regions. The proposed algorithm was tested on the challenging VOC 2012 dataset, the mean intersection-over-union is 58.8% on validation dataset and 57.5% on test dataset. It outperforms the original transfer-learning algorithm by 12.9% and 12.3%. And it performs favorably against other segmentation methods using weakly-supervised information based on category labels as well. © 2019, Editorial Board of Journal on Communications. All right reserved.