Customizing Super-Resolution Framework According to Image Features

As a popular research field of computer vision, super resolution(SR) has received more and more attention in recent years. Although the deep learning methods have achieved good results in SR, there are still some problems. For example, the previous models are often based on single depth mechanism. This means that the SR reconstruction problem of all images is regarded as of equal complexity. And we found that some images have more details and are suitable for recovering in complex models, while other images have less texture information and are suitable for recovering in simple models. At the same time, the size of the training set is too large, which creats a lot of resource overhead. To solve these problems, this paper proposes a new SR framework can be customized according to image features. We choose 3 representative models for testing and in test our framework can reduce the size of the training set by 41.9%. For MSRResNet, we can reduce the training time from 2517 minutes to 2449 minutes. The reconstruction quality of 61% test images has been improved and the average perceptual index has dropped from 5.1912 to 5.155833, at the same time the reconstruction time has been optimized from 85 seconds to 59 seconds. For SRGAN, the training time can be reduced from 1920 minutes to 1812 minutes. The reconstruction quality of 58% test images have been improved and the average perceptual index has dropped from 2.0869 to 2.0509, while the reconstruction time has been optimized from 82 seconds to 46 seconds. For ESRGAN, the training time can be reduced from 4368 minutes to 4249 minutes. The reconstruction quality of 78% test images has been improved and the average perceptual index has dropped from 2.2041 to 2.0535. The reconstruction time has been optimized from 138 seconds to 95 seconds. Our framework can improve the effect of super-resolution models while reducing the resource overhead.