LEARNING NONOVERLAPPING PERCEPTRON NETWORKS FROM EXAMPLES AND MEMBERSHIP QUERIES

被引:1
|
作者
HANCOCK, TR [1 ]
GOLEA, M [1 ]
MARCHAND, M [1 ]
机构
[1] UNIV OTTAWA,OTTAWA CARLETON INST PHYS,OTTAWA K1N 6N5,ON,CANADA
关键词
NEURAL NETWORKS; PAC LEARNING; NONOVERLAPPING; READ-ONCE FORMULA; LEARNING WITH QUERIES;
D O I
10.1007/BF00993305
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We investigate, within the PAC learning model. the problem of learning nonoverlapping perceptron networks (also known as read-once formulas over a weighted threshold basis). These are loop-free neural nets in which each node has only one outgoing weight. We give a polynomial time algorithm that PAC learns any nonovelapping perceptron network using examples and membership queries. The algorithm is able to identify both the architecture and the weight values necessary to represent the function to be learned. Our results shed some light on the effect of the overlap on the complexity of learning in neural networks.
引用
收藏
页码:161 / 183
页数:23
相关论文
共 50 条
  • [31] Learning Context-Free Grammars from Positive Data and Membership Queries
    Kanazawa, Makoto
    LOGIC, LANGUAGE, INFORMATION, AND COMPUTATION, WOLLIC 2023, 2023, 13923 : 3 - 18
  • [32] Learning monotone DNF from a teacher that almost does not answer membership queries
    Bshouty, NH
    Eiron, N
    COMPUTATIONAL LEARNING THEORY, PROCEEDINGS, 2001, 2111 : 546 - 557
  • [33] Exact Learning from Membership Queries: Some Techniques, Results and New Directions
    Bshouty, Nader H.
    ALGORITHMIC LEARNING THEORY (ALT 2013), 2013, 8139 : 33 - 52
  • [34] Learning monotone DNF from a teacher that almost does not answer membership queries
    Bshouty, NH
    Eiron, N
    JOURNAL OF MACHINE LEARNING RESEARCH, 2003, 3 (01) : 49 - 57
  • [35] Exact Learning from Membership Queries: Some Techniques, Results and New Directions
    Bshouty, Nader H.
    Algorithmic Learning Theory (ALT 2013), 2013, 8139
  • [36] LEARNING FROM EXAMPLES IN LARGE NEURAL NETWORKS
    SOMPOLINSKY, H
    TISHBY, N
    SEUNG, HS
    PHYSICAL REVIEW LETTERS, 1990, 65 (13) : 1683 - 1686
  • [37] LEARNING FROM EXAMPLES IN FEEDFORWARD BOOLEAN NETWORKS
    SHUKLA, P
    SINHA, TK
    PHYSICAL REVIEW E, 1993, 47 (04): : 2962 - 2965
  • [38] The Development of Neural Networks applications from Perceptron to Deep Learning
    Al-Mahasneh, Ahmad Jobran
    Anavatti, Sreenatha G.
    Garratt, Matthew A.
    2017 INTERNATIONAL CONFERENCE ON ADVANCED MECHATRONICS, INTELLIGENT MANUFACTURE, AND INDUSTRIAL AUTOMATION (ICAMIMIA), 2017, : 1 - 6
  • [39] Synthesizing Trajectory Queries from Examples
    Mell, Stephen
    Bastani, Favyen
    Zdancewic, Steve
    Bastani, Osbert
    COMPUTER AIDED VERIFICATION, CAV 2023, PT I, 2023, 13964 : 459 - 484
  • [40] LEARNING A DECISION BOUNDARY FROM STOCHASTIC EXAMPLES - INCREMENTAL ALGORITHMS WITH AND WITHOUT QUERIES
    KABASHIMA, Y
    SHINOMOTO, S
    NEURAL COMPUTATION, 1995, 7 (01) : 158 - 172