Semi-supervised contrastive regression for pharmaceutical processes

被引:5
|
作者
Li, Yinlong [1 ]
Liao, Yilin [1 ]
Sun, Ziyue [1 ]
Liu, Xinggao [1 ]
机构
[1] Zhejiang Univ, Coll Control Sci & Engn, State Key Lab Ind Control Technol, Hangzhou 310027, Peoples R China
基金
中国国家自然科学基金;
关键词
Pharmaceutical process; Semi-supervised learning; Contrastive learning; Time series;
D O I
10.1016/j.eswa.2023.121974
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Artificial intelligence methods of time series are starting to play an increasing role in the pharmaceutical field, and in recent years, there have been significant advances in self-supervised representation learning for time series data. However, there are relatively few semi-supervised learning methods for time series, and there is almost no research on semi-supervised representation learning applicable to time series regression tasks. To address this gap, we propose a novel semi-supervised contrastive regression framework (SCRF), which combines two classical frameworks of representation learning. This framework is well-suited for regression problems of time series data from pharmaceutical processes and has been validated on a dataset collected during erythromycin production processes. Our experiments show that SCRF gets better performances than self-supervised and supervised methods, and it is more robust to missing labels, missing data, and random noise. The effectiveness of our novel contrastive learning framework and segmented augmentation methods is demonstrated through experiments.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Semi-supervised Contrastive Regression for Estimation of Eye Gaze
    Maiti, Somsukla
    Gupta, Akshansh
    PATTERN RECOGNITION AND MACHINE INTELLIGENCE, PREMI 2023, 2023, 14301 : 252 - 259
  • [2] CONTRASTIVE SEMI-SUPERVISED LEARNING FOR ASR
    Xiao, Alex
    Fuegen, Christian
    Mohamed, Abdelrahman
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 3870 - 3874
  • [3] Contrastive Regularization for Semi-Supervised Learning
    Lee, Doyup
    Kim, Sungwoong
    Kim, Ildoo
    Cheon, Yeongjae
    Cho, Minsu
    Han, Wook-Shin
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 3910 - 3919
  • [4] Semi-Supervised Linear Regression
    Azriel, David
    Brown, Lawrence D.
    Sklar, Michael
    Berk, Richard
    Buja, Andreas
    Zhao, Linda
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2022, 117 (540) : 2238 - 2251
  • [5] Semi-supervised regression based on Representation Learning for fermentation processes
    Liu, Jing
    Wang, Junxian
    Xia, Jianye
    Lv, Fengfeng
    Wu, Dawei
    COMPUTERS & CHEMICAL ENGINEERING, 2024, 191
  • [6] Semi-supervised logistic regression
    Amini, MR
    Gallinari, P
    ECAI 2002: 15TH EUROPEAN CONFERENCE ON ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2002, 77 : 390 - 394
  • [7] Semi-supervised kernel regression
    Wang, Meng
    Hua, Xian-Sheng
    Song, Yan
    Dai, Li-Rong
    Zhang, Hong-Jiang
    ICDM 2006: Sixth International Conference on Data Mining, Proceedings, 2006, : 1130 - 1135
  • [8] Semi-Supervised Anomaly Detection with Contrastive Regularization
    Jezequel, Loic
    Vu, Ngoc-Son
    Beaudet, Jean
    Histace, Aymeric
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 2664 - 2671
  • [9] A Probabilistic Contrastive Framework for Semi-Supervised Learning
    Lin, Huibin
    Zhang, Chun-Yang
    Wang, Shiping
    Guo, Wenzhong
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 8767 - 8779
  • [10] Semi-Supervised Contrastive Learning for Deep Regression with Ordinal Rankings from Spectral Seriation
    Dai, Weihang
    Du, Yao
    Bai, Hanru
    Cheng, Kwang-Ting
    Li, Xiaomeng
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,