Fish Image Recognition Based on Residual Network and Few-shot Learning

被引:0
|
作者
Yuan P. [1 ]
Song J. [1 ]
Xu H. [1 ]
机构
[1] College of Artificial Intelligence, Nanjing Agricultural University, Nanjing
关键词
Few-shot learning; Fish; Image recognition; Residual network; Transfer learning;
D O I
10.6041/j.issn.1000-1298.2022.02.030
中图分类号
TB18 [人体工程学]; Q98 [人类学];
学科分类号
030303 ; 1201 ;
摘要
Accurate and effective identification of fish images play important role in the observation of fish populations and the management of the ecological environment. However, there were some issues, such as lots of kinds of fish, difficulty of data collection in the complex environments, and fine-grained fish image recognition. For solving the problem of few image annotation of fish image, a few-shot learning method based on metric learning was proposed. Firstly, the residual block structure of ResNet18 was used to improve the few-shot learning network based on metric learning, for extracting the deep features of fish images, and then they were mapped to the embedding space for obtaining the mean center by clustering skills. Secondly, for further improving the recognition accuracy, the improved few-shot learning model was used for pre-training on the mini-ImageNet dataset, and then the training results were transferred to the Fish100 fine-grained dataset for fine-grained training to get the final discrimination model. Based on this model, comparative experiments were conducted with the existing five few-shot learning models on the fish data set Fish100 and ImageNet. The results showed that the model proposed had the best recognition effect and the recognition accuracy on the two datasets reached 94.77% and 91.03%, respectively, and the accuracy, recall rate, and F1 were significantly better than that of other models. The experiments showed that the method proposed can effectively improve the accuracy of few-shot learning in fish identification with few annotated fish images, which can provide technical support and reference for the application of practical fish image recognition. © 2022, Chinese Society of Agricultural Machinery. All right reserved.
引用
收藏
页码:282 / 290
页数:8
相关论文
共 28 条
  • [1] LYNCH A J, COOKE S J, DEINES A M, Et al., The social, economic, and environmental importance of inland fish and fisheries[J], Environmental Reviews, 24, 2, pp. 1-7, (2016)
  • [2] DARGAN S, KUMAR M, AYYAGARI M R., Et al., A survey of deep learning and its applications: a new paradigm to machine learning[J], Archives of Computational Methods in Engineering, 27, 4, pp. 1071-1092, (2020)
  • [3] VAN TREECK R, VAN WICHELEN J, WOLTER C., Fish species sensitivity classification for environmental impact assessment, conservation and restoration planning, Science of the Total Environment, 708, (2020)
  • [4] LIU Ying, LEI Yanbo, ZHANG Jiulun, Et al., A review of image classification techniques based on few-shot learning, Journal of Automation, 47, 2, pp. 297-315, (2021)
  • [5] FEIFEI L, FERGUS R, PERONA P., One-shot learning of object categories, IEEE Transactions on Pattern Analysis and Machine Intelligence, 28, 4, pp. 594-611, (2006)
  • [6] MENSINK T, VERBEEK J, PERRONNIN F, Et al., Metric learning for large scale image classification: generalizing to new classes at near-zero cost, European Conference on Computer Vision, pp. 297-310, (2012)
  • [7] ROHRBACH M, EBERT S, SCHIELE B., Transfer learning in a transductive setting, Neural Information Processing Systems, pp. 46-54, (2013)
  • [8] SANTORO A, BARTUNOV S, BOTVINICK M, Et al., One-shot learning with memory-augmented neural networks[J], (2016)
  • [9] SNELL J, SWERSKY K, ZEMEL R S., Prototypical networks for few-shot learning: neural information processing systems, Neural Information Processing Systems, pp. 4077-4087, (2017)
  • [10] SUNG F, YANG Y, ZHANG L, Et al., Learning to compare: relation network for few-shot learning: computer vision and pattern recognition, Computer Vision and Pattern Recognition, pp. 1199-1208, (2018)