PolyCL: contrastive learning for polymer representation learning via explicit and implicit augmentations

被引:0
|
作者
Zhou, Jiajun [1 ]
Yang, Yijie [1 ]
Mroz, Austin M. [1 ,2 ]
Jelfs, Kim E. [1 ]
机构
[1] Imperial Coll London, Dept Chem, Mol Sci Res Hub, White City Campus,Wood Lane, London W12 0BZ, England
[2] Imperial Coll London, Ctr AI Sci 1 10, White City Campus,Wood Lane, London W12 0BZ, England
来源
DIGITAL DISCOVERY | 2025年 / 4卷 / 01期
基金
欧盟地平线“2020”; 英国工程与自然科学研究理事会; 欧洲研究理事会;
关键词
D O I
10.1039/d4dd00236a
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Polymers play a crucial role in a wide array of applications due to their diverse and tunable properties. Establishing the relationship between polymer representations and their properties is crucial to the computational design and screening of potential polymers via machine learning. The quality of the representation significantly influences the effectiveness of these computational methods. Here, we present a self-supervised contrastive learning paradigm, PolyCL, for learning robust and high-quality polymer representation without the need for labels. Our model combines explicit and implicit augmentation strategies for improved learning performance. The results demonstrate that our model achieves either better, or highly competitive, performances on transfer learning tasks as a feature extractor without an overcomplicated training strategy or hyperparameter optimisation. Further enhancing the efficacy of our model, we conducted extensive analyses on various augmentation combinations used in contrastive learning. This led to identifying the most effective combination to maximise PolyCL's performance.
引用
收藏
页码:149 / 160
页数:12
相关论文
共 50 条
  • [41] Development of implicit and explicit category learning
    Huang-Pollock, Cynthia L.
    Maddox, W. Todd
    Karalunas, Sarah L.
    JOURNAL OF EXPERIMENTAL CHILD PSYCHOLOGY, 2011, 109 (03) : 321 - 335
  • [42] Speaker Representation Learning via Contrastive Loss with Maximal Speaker Separability
    Li, Zhe
    Mak, Man-Wai
    PROCEEDINGS OF 2022 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2022, : 962 - 967
  • [43] Towards an explicit account of implicit learning
    Forkstam, C
    Petersson, KM
    CURRENT OPINION IN NEUROLOGY, 2005, 18 (04) : 435 - 441
  • [44] IMPLICIT AND EXPLICIT STRATEGIES IN LEARNING TO READ
    BRYANT, PE
    BRADLEY, L
    BULLETIN OF THE BRITISH PSYCHOLOGICAL SOCIETY, 1981, 34 (MAY): : 217 - 217
  • [45] Thinking styles in implicit and explicit learning
    Xie, Qiuzhi
    Gao, Xiangping
    King, Ronnel B.
    LEARNING AND INDIVIDUAL DIFFERENCES, 2013, 23 : 267 - 271
  • [46] Implicit and explicit contributions to statistical learning
    Batterink, Laura J.
    Reber, Paul J.
    Neville, Helen J.
    Paller, Ken A.
    JOURNAL OF MEMORY AND LANGUAGE, 2015, 83 : 62 - 78
  • [47] Making implicit explicit: The role of learning
    Homer, BD
    Ramsay, JT
    BEHAVIORAL AND BRAIN SCIENCES, 1999, 22 (05) : 770 - +
  • [48] Implicit and explicit learning in talker identification
    Jayden J. Lee
    Tyler K. Perrachione
    Attention, Perception, & Psychophysics, 2022, 84 : 2002 - 2015
  • [49] Multilingual Molecular Representation Learning via Contrastive Pre-training
    Guo, Zhihui
    Sharma, Pramod
    Martinez, Andy
    Du, Liang
    Abraham, Robin
    PROCEEDINGS OF THE 60TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022), VOL 1: (LONG PAPERS), 2022, : 3441 - 3453
  • [50] Brain Networks of Explicit and Implicit Learning
    Yang, Jing
    Li, Ping
    PLOS ONE, 2012, 7 (08):