GNN-FiLM: Graph Neural Networks with Feature-wise Linear Modulation

被引:0
|
作者
Brockschmidt, Marc [1 ]
机构
[1] Microsoft Res, Cambridge, England
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents a new Graph Neural Network (GNN) type using feature-wise linear modulation (FiLM). Many standard GNN variants propagate information along the edges of a graph by computing messages based only on the representation of the source of each edge. In GNN-FiLM, the representation of the target node of an edge is used to compute a transformation that can be applied to all incoming messages, allowing feature-wise modulation of the passed information. Different GNN architectures are compared in extensive experiments on three tasks from the literature, using re-implementations of many baseline methods. Hyperparameters for all methods were found using extensive search, yielding somewhat surprising results: differences between state of the art models are much smaller than reported in the literature and well-known simple baselines that are often not compared to perform better than recently proposed GNN variants. Nonetheless, GNN-FiLM outperforms these methods on a regression task on molecular graphs and performs competitively on other tasks.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] GNN-FiLM: Graph Neural Networks with Feature-wise Linear Modulation
    Brockschmidt, Marc
    25TH AMERICAS CONFERENCE ON INFORMATION SYSTEMS (AMCIS 2019), 2019,
  • [2] FiLM-Ensemble: Probabilistic Deep Learning via Feature-wise Linear Modulation
    Turkoglu, Mehmet Ozgur
    Becker, Alexander
    Guenduez, Hueseyin Anil
    Rezaei, Mina
    Bischl, Bernd
    Daudt, Rodrigo Caye
    D'Aronco, Stefano
    Wegner, Jan Dirk
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
  • [3] Temporal FiLM: Capturing Long-Range Sequence Dependencies with Feature-Wise Modulation
    Birnbaum, Sawyer
    Kuleshov, Volodymyr
    Enam, S. Zayd
    Koh, Pang Wei
    Ermon, Stefano
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [4] A feature-wise attention module based on the difference with surrounding features for convolutional neural networks
    Tan, Shuo
    Zhang, Lei
    Shu, Xin
    Wang, Zizhou
    FRONTIERS OF COMPUTER SCIENCE, 2023, 17 (06)
  • [5] A feature-wise attention module based on the difference with surrounding features for convolutional neural networks
    Shuo TAN
    Lei ZHANG
    Xin SHU
    Zizhou WANG
    Frontiers of Computer Science, 2023, 17 (06) : 79 - 88
  • [6] Improved Birthweight Prediction With Feature-Wise Linear Modulation, GRU, and Attention Mechanism in Ultrasound Data
    Priya, G. Mohana
    Sangeetha, S. K. B.
    JOURNAL OF ULTRASOUND IN MEDICINE, 2025, 44 (04) : 711 - 725
  • [7] Efficient Deweather Mixture-of-Experts with Uncertainty-Aware Feature-Wise Linear Modulation
    Zhang, Rongyu
    Luo, Yulin
    Liu, Jiaming
    Yang, Huanrui
    Dong, Zhen
    Gudovskiy, Denis
    Okuno, Tomoyuki
    Nakata, Yohei
    Keutzer, Kurt
    Du, Yuan
    Zhang, Shanghang
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 15, 2024, : 16812 - 16820
  • [8] GNN2GNN: Graph Neural Networks to Generate Neural Networks
    Agiollo, Andrea
    Omicini, Andrea
    UNCERTAINTY IN ARTIFICIAL INTELLIGENCE, VOL 180, 2022, 180 : 32 - 42
  • [9] HiGNN: A Hierarchical Informative Graph Neural Network for Molecular Property Prediction Equipped with Feature-Wise Attention
    Zhu, Weimin
    Zhang, Yi
    Zhao, Duancheng
    Xu, Jianrong
    Wang, Ling
    JOURNAL OF CHEMICAL INFORMATION AND MODELING, 2023, 63 (01) : 43 - 55
  • [10] FLAN: feature-wise latent additive neural models for biological applications
    Nguyen, An-Phi
    Vasilaki, Stefania
    Martinez, Maria Rodriguez
    BRIEFINGS IN BIOINFORMATICS, 2023, 24 (03)