PolyCL: contrastive learning for polymer representation learning via explicit and implicit augmentations

被引:0
|
作者
Zhou, Jiajun [1 ]
Yang, Yijie [1 ]
Mroz, Austin M. [1 ,2 ]
Jelfs, Kim E. [1 ]
机构
[1] Imperial Coll London, Dept Chem, Mol Sci Res Hub, White City Campus,Wood Lane, London W12 0BZ, England
[2] Imperial Coll London, Ctr AI Sci 1 10, White City Campus,Wood Lane, London W12 0BZ, England
来源
DIGITAL DISCOVERY | 2025年 / 4卷 / 01期
基金
欧盟地平线“2020”; 英国工程与自然科学研究理事会; 欧洲研究理事会;
关键词
D O I
10.1039/d4dd00236a
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Polymers play a crucial role in a wide array of applications due to their diverse and tunable properties. Establishing the relationship between polymer representations and their properties is crucial to the computational design and screening of potential polymers via machine learning. The quality of the representation significantly influences the effectiveness of these computational methods. Here, we present a self-supervised contrastive learning paradigm, PolyCL, for learning robust and high-quality polymer representation without the need for labels. Our model combines explicit and implicit augmentation strategies for improved learning performance. The results demonstrate that our model achieves either better, or highly competitive, performances on transfer learning tasks as a feature extractor without an overcomplicated training strategy or hyperparameter optimisation. Further enhancing the efficacy of our model, we conducted extensive analyses on various augmentation combinations used in contrastive learning. This led to identifying the most effective combination to maximise PolyCL's performance.
引用
收藏
页码:149 / 160
页数:12
相关论文
共 50 条
  • [31] Unsupervised Sentence Representation via Contrastive Learning with Mixing Negatives
    Zhang, Yanzhao
    Zhang, Richong
    Mensah, Samuel
    Liu, Xudong
    Mao, Yongyi
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 11730 - 11738
  • [32] Making Linear MDPs Practical via Contrastive Representation Learning
    Zhang, Tianjun
    Ren, Tongzheng
    Yang, Mengjiao
    Gonzalez, Joseph E.
    Schuurmans, Dale
    Dai, Bo
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [33] The interaction of implicit learning, explicit hypothesis testing learning and implicit-to-explicit knowledge extraction
    Sun, Ron
    Zhang, Xi
    Slusarz, Paul
    Mathews, Robert
    NEURAL NETWORKS, 2007, 20 (01) : 34 - 47
  • [34] Representation Learning via Adversarially-Contrastive Optimal Transport
    Cherian, Anoop
    Aeron, Shuchin
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 119, 2020, 119
  • [35] Transferable Implicit Solvation via Contrastive Learning of Graph Neural Networks
    Airas, Justin
    Ding, Xinqiang
    Zhang, Bin
    ACS CENTRAL SCIENCE, 2023, 9 (12) : 2286 - 2297
  • [36] Analysis of Augmentations in Contrastive Learning for Parkinson's Disease Diagnosis
    Wang, Shuangyi
    Zhou, Tianren
    Shen, Zhaoyan
    Jia, Zhiping
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT IV, 2023, 14257 : 37 - 50
  • [37] Implicit and Explicit Feature Purification for Age-Invariant Facial Representation Learning
    Xie, Jiu-Cheng
    Pun, Chi-Man
    Lam, Kin-Man
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2022, 17 : 399 - 412
  • [38] Interactive Augmentations, Features, and Parameters for Contrastive Learning [AI-eXplained]
    Chen, Yu-Ting
    Chiou, Chien-Yu
    Huang, Chun-Rong
    IEEE COMPUTATIONAL INTELLIGENCE MAGAZINE, 2024, 19 (01) : 79 - 80
  • [39] Contrastive State Augmentations for Reinforcement Learning-Based Recommender Systems
    Ren, Zhaochun
    Huang, Na
    Wang, Yidan
    Ren, Pengjie
    Ma, Jun
    Lei, Jiahuan
    Shi, Xinlei
    Luo, Hengliang
    Jose, Joemon
    Xin, Xin
    PROCEEDINGS OF THE 46TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2023, 2023, : 922 - 931
  • [40] Ethereum Phishing Scams Detection Based on Graph Contrastive Learning with Augmentations
    Chen, Yongxin
    Hou, Wenhan
    Zhang, Xin
    Li, Ru
    PROCEEDINGS OF THE 2024 27 TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, CSCWD 2024, 2024, : 2047 - 2052