LEARNING NONOVERLAPPING PERCEPTRON NETWORKS FROM EXAMPLES AND MEMBERSHIP QUERIES

被引:1
|
作者
HANCOCK, TR [1 ]
GOLEA, M [1 ]
MARCHAND, M [1 ]
机构
[1] UNIV OTTAWA,OTTAWA CARLETON INST PHYS,OTTAWA K1N 6N5,ON,CANADA
关键词
NEURAL NETWORKS; PAC LEARNING; NONOVERLAPPING; READ-ONCE FORMULA; LEARNING WITH QUERIES;
D O I
10.1007/BF00993305
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We investigate, within the PAC learning model. the problem of learning nonoverlapping perceptron networks (also known as read-once formulas over a weighted threshold basis). These are loop-free neural nets in which each node has only one outgoing weight. We give a polynomial time algorithm that PAC learns any nonovelapping perceptron network using examples and membership queries. The algorithm is able to identify both the architecture and the weight values necessary to represent the function to be learned. Our results shed some light on the effect of the overlap on the complexity of learning in neural networks.
引用
收藏
页码:161 / 183
页数:23
相关论文
共 50 条
  • [21] Learning boolean halfspaces with small weights from membership queries
    Abasi, Hasan
    Abdi, Ali Z.
    Bshouty, Nader H.
    THEORETICAL COMPUTER SCIENCE, 2016, 650 : 45 - 56
  • [22] Learning Boolean Halfspaces with Small Weights from Membership Queries
    Abasi, Hasan
    Abdi, Ali Z.
    Bshouty, Nader H.
    ALGORITHMIC LEARNING THEORY (ALT 2014), 2014, 8776 : 96 - 110
  • [23] Adaptive Exact Learning of Decision Trees from Membership Queries
    Bshouty, Nader H.
    Haddad-Zaknoon, Catherine A.
    ALGORITHMIC LEARNING THEORY, VOL 98, 2019, 98
  • [24] Extending Distributional Learning from Positive Data and Membership Queries
    Kanazawa, Makoto
    Yoshinaka, Ryo
    INTERNATIONAL CONFERENCE ON GRAMMATICAL INFERENCE, VOL 217, 2023, 217 : 8 - 22
  • [25] Exact learning from an honest teacher that answers membership queries
    Bshouty, Nader H.
    THEORETICAL COMPUTER SCIENCE, 2018, 733 : 4 - 43
  • [26] A Generic Algorithm for Learning Symbolic Automata from Membership Queries
    Maler, Oded
    Mens, Irini-Eleftheria
    MODELS, ALGORITHMS, LOGICS AND TOOLS: ESSAYS DEDICATED TO KIM GULDSTRAND LARSEN ON THE OCCASION OF HIS 60TH BIRTHDAY, 2017, 10460 : 146 - 169
  • [27] STABILITY OF THE REPLICA-SYMMETRICAL SOLUTION FOR A PERCEPTRON LEARNING FROM EXAMPLES
    KWON, C
    PARK, YG
    OH, JH
    PHYSICAL REVIEW E, 1993, 47 (05): : 3707 - 3711
  • [28] PAC Learning Intersections of Halfspaces with Membership Queries
    S. Kwek
    L. Pitt
    Algorithmica, 1998, 22 : 53 - 75
  • [29] A learning with membership queries to minimize prediction error
    Ukita, Y
    Matsushima, T
    Hirasawa, S
    SMC '97 CONFERENCE PROCEEDINGS - 1997 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS, VOLS 1-5: CONFERENCE THEME: COMPUTATIONAL CYBERNETICS AND SIMULATION, 1997, : 4412 - 4417
  • [30] PAC learning intersections of halfspaces with membership queries
    Kwek, S
    Pitt, L
    ALGORITHMICA, 1998, 22 (1-2) : 53 - 75