Semi-supervised contrastive regression for pharmaceutical processes

被引:5
|
作者
Li, Yinlong [1 ]
Liao, Yilin [1 ]
Sun, Ziyue [1 ]
Liu, Xinggao [1 ]
机构
[1] Zhejiang Univ, Coll Control Sci & Engn, State Key Lab Ind Control Technol, Hangzhou 310027, Peoples R China
基金
中国国家自然科学基金;
关键词
Pharmaceutical process; Semi-supervised learning; Contrastive learning; Time series;
D O I
10.1016/j.eswa.2023.121974
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Artificial intelligence methods of time series are starting to play an increasing role in the pharmaceutical field, and in recent years, there have been significant advances in self-supervised representation learning for time series data. However, there are relatively few semi-supervised learning methods for time series, and there is almost no research on semi-supervised representation learning applicable to time series regression tasks. To address this gap, we propose a novel semi-supervised contrastive regression framework (SCRF), which combines two classical frameworks of representation learning. This framework is well-suited for regression problems of time series data from pharmaceutical processes and has been validated on a dataset collected during erythromycin production processes. Our experiments show that SCRF gets better performances than self-supervised and supervised methods, and it is more robust to missing labels, missing data, and random noise. The effectiveness of our novel contrastive learning framework and segmented augmentation methods is demonstrated through experiments.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] Contrastive Semi-Supervised Learning for Image Highlight Removal
    Li, Pengyue
    Li, Xiaolan
    Li, Wentao
    Xu, Xinying
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 1334 - 1338
  • [22] Class-Aware Contrastive Semi-Supervised Learning
    Yang, Fan
    Wu, Kai
    Zhang, Shuyi
    Jiang, Guannan
    Liu, Yong
    Zheng, Feng
    Zhang, Wei
    Wang, Chengjie
    Zeng, Long
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 14401 - 14410
  • [23] CoMatch: Semi-supervised Learning with Contrastive Graph Regularization
    Li, Junnan
    Xiong, Caiming
    Hoi, Steven C. H.
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 9455 - 9464
  • [24] Contrastive Pessimistic Likelihood Estimation for Semi-Supervised Classification
    Loog, Marco
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (03) : 462 - 475
  • [25] Semi-Supervised Action Recognition with Temporal Contrastive Learning
    Singh, Ankit
    Chakraborty, Omprakash
    Varshney, Ashutosh
    Panda, Rameswar
    Feris, Rogerio
    Saenko, Kate
    Das, Abir
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 10384 - 10394
  • [26] Semi-Supervised Contrastive Learning for Human Activity Recognition
    Liu, Dongxin
    Abdelzaher, Tarek
    17TH ANNUAL INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING IN SENSOR SYSTEMS (DCOSS 2021), 2021, : 45 - 53
  • [27] Boosting semi-supervised learning with Contrastive Complementary Labeling
    Deng, Qinyi
    Guo, Yong
    Yang, Zhibang
    Pan, Haolin
    Chen, Jian
    NEURAL NETWORKS, 2024, 170 : 417 - 426
  • [28] CONTRASTIVE SIAMESE NETWORK FOR SEMI-SUPERVISED SPEECH RECOGNITION
    Khorram, Soheil
    Kim, Jaeyoung
    Tripathi, Anshuman
    Lu, Han
    Zhang, Qian
    Sak, Hasim
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 7207 - 7211
  • [29] Semi-supervised Learning with Gaussian Processes
    Li, Hongwei
    Li, Yakui
    Lu, Hanqing
    PROCEEDINGS OF THE 2008 CHINESE CONFERENCE ON PATTERN RECOGNITION (CCPR 2008), 2008, : 13 - 17
  • [30] SEMI-SUPERVISED HYPERSPECTRAL MANIFOLD LEARNING FOR REGRESSION
    Uto, Kuniaki
    Kosugi, Yukio
    Saito, Genya
    2015 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2015, : 9 - 12