LEARNING NONOVERLAPPING PERCEPTRON NETWORKS FROM EXAMPLES AND MEMBERSHIP QUERIES

被引:1
|
作者
HANCOCK, TR [1 ]
GOLEA, M [1 ]
MARCHAND, M [1 ]
机构
[1] UNIV OTTAWA,OTTAWA CARLETON INST PHYS,OTTAWA K1N 6N5,ON,CANADA
关键词
NEURAL NETWORKS; PAC LEARNING; NONOVERLAPPING; READ-ONCE FORMULA; LEARNING WITH QUERIES;
D O I
10.1007/BF00993305
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We investigate, within the PAC learning model. the problem of learning nonoverlapping perceptron networks (also known as read-once formulas over a weighted threshold basis). These are loop-free neural nets in which each node has only one outgoing weight. We give a polynomial time algorithm that PAC learns any nonovelapping perceptron network using examples and membership queries. The algorithm is able to identify both the architecture and the weight values necessary to represent the function to be learned. Our results shed some light on the effect of the overlap on the complexity of learning in neural networks.
引用
收藏
页码:161 / 183
页数:23
相关论文
共 50 条
  • [41] On Learning Regular Expressions and Patterns Via Membership and Correction Queries
    Kinber, Efim
    GRAMMATICAL INFERENCE: ALGORITHMS AND APPLICATIONS, PROCEEDINGS, 2008, 5278 : 125 - 138
  • [42] Learning Conditional Preference Networks from Inconsistent Examples
    Liu, Juntao
    Xiong, Yi
    Wu, Caihua
    Yao, Zhijun
    Liu, Wenyu
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2014, 26 (02) : 376 - 390
  • [43] IDENTIFICATION OF PATTERN LANGUAGES FROM EXAMPLES AND QUERIES
    MARRON, A
    KO, KI
    INFORMATION AND COMPUTATION, 1987, 74 (02) : 91 - 112
  • [44] Variants of memetic and hybrid learning of perceptron networks
    Neruda, Roman
    Slusny, Stanislav
    DEXA 2007: 18TH INTERNATIONAL CONFERENCE ON DATABASE AND EXPERT SYSTEMS APPLICATIONS, PROCEEDINGS, 2007, : 158 - +
  • [45] AN ACCELERATED LEARNING ALGORITHM FOR MULTILAYER PERCEPTRON NETWORKS
    PARLOS, AG
    FERNANDEZ, B
    ATIYA, AF
    MUTHUSAMI, J
    TSAI, WK
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 1994, 5 (03): : 493 - 497
  • [46] An unsupervised learning approach for multilayer perceptron networks
    Aldana-Bobadila, Edwin
    Kuri-Morales, Angel
    Lopez-Arevalo, Ivan
    Rios-Alvarado, Ana B.
    SOFT COMPUTING, 2019, 23 (21) : 11001 - 11013
  • [47] Learning Conditional Preference Networks with Queries
    Koriche, Frederic
    Zanuttini, Bruno
    21ST INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE (IJCAI-09), PROCEEDINGS, 2009, : 1930 - 1935
  • [48] Lower bounds for the complexity of learning half-spaces with membership queries
    Shevchenko, VN
    Zolotykh, NY
    ALGORITHMIC LEARNING THEORY, 1998, 1501 : 61 - 71
  • [49] On distribution-specific learning with membership queries versus pseudorandom generation
    Köbler, J
    Lindner, W
    FST TCS 2000: FOUNDATIONS OF SOFTWARE TECHNOLOGY AND THEORETICAL COMPUTER SCIENCE, PROCEEDINGS, 2000, 1974 : 336 - 347
  • [50] Learning a subclass of k-quasi-Horn formulas with membership queries
    Lavin Puente, Victor
    INFORMATION PROCESSING LETTERS, 2011, 111 (11) : 550 - 555