Extracting decision trees from trained neural networks

被引:70
|
作者
Krishnan, R [1 ]
Sivakumar, G [1 ]
Bhattacharya, P [1 ]
机构
[1] Indian Inst Technol, Dept Comp Sci & Engn, Bombay 400076, Maharashtra, India
关键词
rule extraction; decision trees; data mining; knowledge discovery; classification;
D O I
10.1016/S0031-3203(98)00181-2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper we present a methodology for extracting decision trees from input data generated from trained neural networks instead of doing it directly from the data. A genetic algorithm is used to query the trained network and extract prototypes. A prototype selection mechanism is then used to select a subset of the prototypes. Finally, a standard induction method like ID3 or C5.0 is used to extract the decision tree. The extracted decision trees can be used to understand the working of the neural network besides performing classification. This method is able to extract different decision trees of high accuracy and comprehensibility from the trained neural network. (C) 1999 Pattern Recognition Society. Published by Elsevier Science Ltd. All rights reserved.
引用
收藏
页码:1999 / 2009
页数:11
相关论文
共 50 条
  • [21] Initialization of neural networks by means of decision trees
    Ivanova, I
    Kubat, M
    KNOWLEDGE-BASED SYSTEMS, 1995, 8 (06) : 333 - 344
  • [22] A comparison between neural networks and decision trees
    Jacobsen, C
    Zscherpel, U
    Perner, P
    MACHINE LEARNING AND DATA MINING IN PATTERN RECOGNITION, 1999, 1715 : 144 - 158
  • [23] Extracting symbolic rules from trained neural network ensembles
    Zhou, ZH
    Jiang, Y
    Chen, SF
    AI COMMUNICATIONS, 2003, 16 (01) : 3 - 15
  • [24] Extracting finite-state representations from recurrent neural networks trained on chaotic symbolic sequences
    Tino, P
    Köteles, M
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 1999, 10 (02): : 284 - 302
  • [25] Extracting trees from trained SVM models using a TREPAN based approach
    Torres, DED
    Rocco, CMS
    HIS 2005: 5th International Conference on Hybrid Intelligent Systems, Proceedings, 2005, : 353 - 358
  • [26] Tagging of corpora with HMM, decision trees and neural networks
    Schmid, H
    Kempe, A
    LEXICON AND TEST: REUSABLE METHODS AND RESOURCES FOR THE LINGUISTIC DEVELOPMENT OF GERMAN, 1996, 73 : 231 - 244
  • [27] Eclectic Rule Extraction from Neural Networks Using Aggregated Decision Trees
    Al Iqbal, Md. Ridwan
    2012 7TH INTERNATIONAL CONFERENCE ON ELECTRICAL AND COMPUTER ENGINEERING (ICECE), 2012,
  • [28] A Comparison of GE Optimized Neural Networks and Decision Trees
    Hoover, Kristopher
    Marceau, Rachel
    Harris, Tyndall
    Reif, David
    Motsinger-Reif, Alison
    PROCEEDINGS OF THE FOURTEENTH INTERNATIONAL CONFERENCE ON GENETIC AND EVOLUTIONARY COMPUTATION COMPANION (GECCO'12), 2012, : 611 - 614
  • [29] Hybrid Ensembles of Decision Trees and Artificial Neural Networks
    Hsu, Kuo-Wei
    2012 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND CYBERNETICS (CYBERNETICSCOM), 2012, : 25 - 29
  • [30] Visualizing surrogate decision trees of convolutional neural networks
    Shichao Jia
    Peiwen Lin
    Zeyu Li
    Jiawan Zhang
    Shixia Liu
    Journal of Visualization, 2020, 23 : 141 - 156