PolyCL: contrastive learning for polymer representation learning via explicit and implicit augmentations

被引:0
|
作者
Zhou, Jiajun [1 ]
Yang, Yijie [1 ]
Mroz, Austin M. [1 ,2 ]
Jelfs, Kim E. [1 ]
机构
[1] Imperial Coll London, Dept Chem, Mol Sci Res Hub, White City Campus,Wood Lane, London W12 0BZ, England
[2] Imperial Coll London, Ctr AI Sci 1 10, White City Campus,Wood Lane, London W12 0BZ, England
来源
DIGITAL DISCOVERY | 2025年 / 4卷 / 01期
基金
欧盟地平线“2020”; 英国工程与自然科学研究理事会; 欧洲研究理事会;
关键词
D O I
10.1039/d4dd00236a
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Polymers play a crucial role in a wide array of applications due to their diverse and tunable properties. Establishing the relationship between polymer representations and their properties is crucial to the computational design and screening of potential polymers via machine learning. The quality of the representation significantly influences the effectiveness of these computational methods. Here, we present a self-supervised contrastive learning paradigm, PolyCL, for learning robust and high-quality polymer representation without the need for labels. Our model combines explicit and implicit augmentation strategies for improved learning performance. The results demonstrate that our model achieves either better, or highly competitive, performances on transfer learning tasks as a feature extractor without an overcomplicated training strategy or hyperparameter optimisation. Further enhancing the efficacy of our model, we conducted extensive analyses on various augmentation combinations used in contrastive learning. This led to identifying the most effective combination to maximise PolyCL's performance.
引用
收藏
页码:149 / 160
页数:12
相关论文
共 50 条
  • [21] Time Series Contrastive Learning with Information-Aware Augmentations
    Luo, Dongsheng
    Cheng, Wei
    Wang, Yingheng
    Xu, Dongkuan
    Ni, Jingchao
    Yu, Wenchao
    Zhang, Xuchao
    Liu, Yanchi
    Chen, Yuncong
    Chen, Haifeng
    Zhang, Xiang
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 4, 2023, : 4534 - 4542
  • [22] Masked Contrastive Representation Learning for Reinforcement Learning
    Zhu, Jinhua
    Xia, Yingce
    Wu, Lijun
    Deng, Jiajun
    Zhou, Wengang
    Qin, Tao
    Liu, Tie-Yan
    Li, Houqiang
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (03) : 3421 - 3433
  • [23] Unsupervised Representation for Semantic Segmentation by Implicit Cycle-Attention Contrastive Learning
    Pang, Bo
    Li, Yizhuo
    Zhang, Yifan
    Peng, Gao
    Tang, Jiajun
    Zha, Kaiwen
    Li, Jiefeng
    Lu, Cewu
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 2044 - 2052
  • [24] Heterogeneous Graph Contrastive Learning With Metapath-Based Augmentations
    Chen, Xiaoru
    Wang, Yingxu
    Fang, Jinyuan
    Meng, Zaiqiao
    Liang, Shangsong
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, 8 (01): : 1003 - 1014
  • [25] Distinguishing implicit and explicit learning
    Stadler, MA
    PSYCHONOMIC BULLETIN & REVIEW, 1997, 4 (01) : 56 - 62
  • [26] Distinguishing implicit and explicit learning
    Michael A. Stadler
    Psychonomic Bulletin & Review, 1997, 4 : 56 - 62
  • [27] Contrastive Code Representation Learning
    Jain, Paras
    Jain, Ajay
    Zhang, Tianjun
    Abbeel, Pieter
    Gonzalez, Joseph E.
    Stoica, Ion
    2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), 2021, : 5954 - 5971
  • [28] Are Graph Augmentations Necessary? Simple Graph Contrastive Learning for Recommendation
    Yu, Junliang
    Yin, Hongzhi
    Xia, Xin
    Chen, Tong
    Cui, Lizhen
    Nguyen, Quoc Viet Hung
    PROCEEDINGS OF THE 45TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '22), 2022, : 1294 - 1303
  • [29] Consistent representation via contrastive learning for skin lesion diagnosis
    Wang, Zizhou
    Zhang, Lei
    Shu, Xin
    Wang, Yan
    Feng, Yangqin
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2023, 242
  • [30] Representation Learning via Adversarially-Contrastive Optimal Transport
    Cherian, Anoop
    Aeron, Shuchin
    25TH AMERICAS CONFERENCE ON INFORMATION SYSTEMS (AMCIS 2019), 2019,