Learning Predictive Substructures with Regularization for Network Data

被引:2
|
作者
Dang, Xuan Hong [1 ]
You, Hongyuan [1 ]
Bogdanov, Petko [2 ]
Singh, Ambuj K. [1 ]
机构
[1] Univ Calif Santa Barbara, Santa Barbara, CA 93106 USA
[2] SUNY Albany, Albany, NY 12222 USA
关键词
D O I
10.1109/ICDM.2015.56
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Learning a succinct set of substructures that predicts global network properties plays a key role in understanding complex network data. Existing approaches address this problem by sampling the exponential space of all possible subnetworks to find ones of high prediction accuracy. In this paper, we develop a novel framework that avoids sampling by formulating the problem of predictive subnetwork learning as node selection, subject to network-constrained regularization. Our framework involves two steps: (i) subspace learning, and (ii) predictive substructures discovery with network regularization. The framework is developed based upon two mathematically sound techniques of spectral graph learning and gradient descent optimization, and we show that their solutions converge to a global optimum solution-a desired property that cannot be guaranteed by sampling approaches. Through experimental analysis on a number of real world datasets, we demonstrate the performance of our framework against state-of-the-art algorithms, not only based on prediction accuracy but also in terms of domain relevance of the discovered substructures.
引用
收藏
页码:81 / 90
页数:10
相关论文
共 50 条
  • [1] LEARNING THE RELEVANT SUBSTRUCTURES FOR TASKS ON GRAPH DATA
    Chen, Lei
    Chen, Zhengdao
    Bruna, Joan
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 8528 - 8532
  • [2] Regularization of Sequence Data for Machine Learning
    Bai, Bryan
    Kremer, Stefan C.
    2011 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE WORKSHOPS, 2011, : 19 - 25
  • [3] A partial convolution-based deep-learning network for seismic data regularization
    Pan, Shulin
    Chen, Kai
    Chen, Jingyi
    Qin, Ziyu
    Cui, Qinghui
    Li, Jing
    COMPUTERS & GEOSCIENCES, 2020, 145
  • [4] On the impact of regularization in data-driven predictive control
    Breschi, Valentina
    Chiuso, Alessandro
    Fabris, Marco
    Formentin, Simone
    2023 62ND IEEE CONFERENCE ON DECISION AND CONTROL, CDC, 2023, : 3061 - 3066
  • [5] Flexible constraints for regularization in learning from data
    Hüllermeier, E
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2004, 19 (06) : 525 - 541
  • [6] FROM DATA DISTRIBUTIONS TO REGULARIZATION IN INVARIANT LEARNING
    LEEN, TK
    NEURAL COMPUTATION, 1995, 7 (05) : 974 - 981
  • [7] From data distributions to regularization in invariant learning
    Leen, Todd K.
    1995, MIT Press, Cambridge, MA, USA (07)
  • [8] Deep learning regularization techniques to genomics data
    Soumare, Harouna
    Benkahla, Alia
    Gmati, Nabil
    ARRAY, 2021, 11
  • [9] Regularization and statistical learning theory for data analysis
    Evgeniou, T
    Poggio, T
    Pontil, M
    Verri, A
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2002, 38 (04) : 421 - 432
  • [10] Backpropagation With Sparsity Regularization for Spiking Neural Network Learning
    Yan, Yulong
    Chu, Haoming
    Jin, Yi
    Huan, Yuxiang
    Zou, Zhuo
    Zheng, Lirong
    FRONTIERS IN NEUROSCIENCE, 2022, 16