Multi-Task Mixture Density Graph Neural Networks for Predicting Catalyst Performance

被引:18
|
作者
Liang, Chen [1 ,2 ]
Wang, Bowen [3 ]
Hao, Shaogang [4 ]
Chen, Guangyong [5 ]
Heng, Pheng-Ann [3 ]
Zou, Xiaolong [1 ,2 ]
机构
[1] Tsinghua Univ, Inst Mat Res, Shenzhen Geim Graphene Ctr, Tsinghua Shenzhen Int Grad Sch, Shenzhen 518055, Peoples R China
[2] Tsinghua Univ, Inst Mat Res, Tsinghua Shenzhen Int Grad Sch, Shenzhen Key Lab Adv Layered Mat Value Added Appli, Shenzhen 518055, Peoples R China
[3] Chinese Univ Hong Kong, Dept Comp Sci & Engn, Hong Kong 999077, Peoples R China
[4] Tencent, Shenzhen 518054, Peoples R China
[5] Zhejiang Univ, Zhejiang Lab, Hangzhou 311121, Peoples R China
基金
中国国家自然科学基金;
关键词
catalyst design; CO2 reduction reaction; graph neural network; machine learning; multi-task learning; MACHINE LEARNING FRAMEWORK; CO2; REDUCTION; ELECTROREDUCTION; ELECTROCATALYSTS; SELECTIVITY; REACTIVITY; PRINCIPLE; DISCOVERY; DESIGN; MODEL;
D O I
10.1002/adfm.202404392
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Graph neural networks (GNNs) have drawn more and more attention from material scientists and demonstrated a strong capacity to establish connections between structures and properties. However, with only unrelaxed structures provided as input, few GNN models can predict the thermodynamic properties of relaxed configurations with an acceptable level of error. In this work, a multi-task (MT) architecture based on DimeNet++ and mixture density networks is developed to improve the performance of such task. Taking CO adsorption on Cu-based single-atom alloy catalysts as an example, the method can reliably predict CO adsorption energy with a mean absolute error of 0.087 eV from the initial CO adsorption structures without costly first-principles calculations. Compared to other state-of-the-art GNN methods, the model exhibits improved generalization ability when predicting the catalytic performance of out-of-distribution configurations, built with either unseen substrate surfaces or doping species. Further, the enhancement of expressivity has also been demonstrated on the IS2RE predicting task in the Open Catalyst 2020 project. The proposed MT GNN strategy can facilitate the catalyst discovery and optimization process.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] Multi-Task Learning Based on Stochastic Configuration Neural Networks
    Dong, Xue-Mei
    Kong, Xudong
    Zhang, Xiaoping
    FRONTIERS IN BIOENGINEERING AND BIOTECHNOLOGY, 2022, 10
  • [32] Federated Multi-task Graph Learning
    Liu, Yijing
    Han, Dongming
    Zhang, Jianwei
    Zhu, Haiyang
    Xu, Mingliang
    Chen, Wei
    ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2022, 13 (05)
  • [33] Multi-Task Reinforcement Meta-Learning in Neural Networks
    Shakah, Ghazi
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2022, 13 (07) : 263 - 269
  • [34] Evolving Deep Parallel Neural Networks for Multi-Task Learning
    Wu, Jie
    Sun, Yanan
    ALGORITHMS AND ARCHITECTURES FOR PARALLEL PROCESSING, ICA3PP 2021, PT II, 2022, 13156 : 517 - 531
  • [35] Predicting Rumor Veracity on Social Media with Graph Structured Multi-task Learning
    Liu, Yudong
    Yang, Xiaoyu
    Zhang, Xi
    Tang, Zhihao
    Chen, Zongyi
    Liwen, Zheng
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, DASFAA 2022, PT III, 2022, : 230 - 237
  • [36] Brain Networks Classification Based on an Adaptive Multi-Task Convolutional Neural Networks
    Xing X.
    Ji J.
    Yao Y.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2020, 57 (07): : 1449 - 1459
  • [37] Multi-Adaptive Optimization for multi-task learning with deep neural networks
    Hervella, alvaro S.
    Rouco, Jose
    Novo, Jorge
    Ortega, Marcos
    NEURAL NETWORKS, 2024, 170 : 254 - 265
  • [38] Multi-Task Deep Neural Networks for Multi-Document Reading Comprehension
    Liu, Chang
    Liu, Zhuang
    Lin, Wayne
    Zhao, Jun
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [39] Training Physics-Informed Neural Networks via Multi-Task Optimization for Traffic Density Prediction
    Wang, Bo
    Qin, A. K.
    Shafiei, Sajjad
    Dia, Hussein
    Mihaita, Adriana-Simona
    Grzybowska, Hanna
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [40] Deep Convolutional Neural Networks for Multi-Instance Multi-Task Learning
    Zeng, Tao
    Ji, Shuiwang
    2015 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2015, : 579 - 588