Impartial competitive learning in multi-layered neural networks

被引:0
|
作者
Kamimura, Ryotaro [1 ,2 ,3 ]
机构
[1] Tokai Univ, IT Educ Ctr, Hiratsuka, Kanagawa, Japan
[2] Kumamoto Drone Technol & Dev, Nishi Ku, Kamimatsuo, Kumamoto, Japan
[3] Kumamoto Drone Technol & Dev, Nishi Ku, Kamimatsuo, Kumamoto 8615289, Japan
关键词
Impartial; competitive learning; componential competition; computational competition; collective competition; cost; interpretation; MUTUAL INFORMATION; ENGLISH;
D O I
10.1080/09540091.2023.2174079
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The present paper aims to propose a new learning and interpretation method called "impartial competitive learning", meaning that all participants in a competition should be winners. Due to its importance, the impartiality is forced to be realised even by increasing the corresponding cost in terms of the strength of weights. For the first approximation, three types of impartial competition can be developed: componential, computational, and collective competition. In the componential competition, every weight should have an equal chance on average to win the competition. In the computational competition, all computational procedures should have an equal chance to be applied sequentially in learning. In collective computing for interpretation, all network configurations, obtained by learning, have an equal chance to participate in a process of interpretation, representing one of the most idealised forms of impartiality. The method was applied to a well-known second-language-learning data set. The intuitive conclusion, stressed in the specific science, could not be extracted by the conventional natural language processing methods, because they can deal only with word frequency. The present method tried to extract a main feature beyond the word frequency by competing connection weights and computational procedures impartially, followed by collective and impartial competition for interpretation.
引用
收藏
页数:33
相关论文
共 50 条
  • [31] Multi-level selective potentiality maximization for interpreting multi-layered neural networks
    Ryotaro Kamimura
    Applied Intelligence, 2022, 52 : 13961 - 13986
  • [32] Evaluation of multi-layered RBF networks
    Hirasawa, K
    Matsuoka, T
    Ohbayashi, M
    Murata, J
    SMC '97 CONFERENCE PROCEEDINGS - 1997 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS, VOLS 1-5: CONFERENCE THEME: COMPUTATIONAL CYBERNETICS AND SIMULATION, 1997, : 908 - 911
  • [33] On Modeling and Analyzing Multi-Layered Networks
    Kennedy, Kevin T.
    Deckro, Richard F.
    Chrissis, James W.
    Wiley, Victor D.
    MILITARY OPERATIONS RESEARCH, 2009, 14 (03) : 53 - 66
  • [34] Improving collective interpretation by extended potentiality assimilation for multi-layered neural networks
    Kamimura, Ryotaro
    Takeuchi, Haruhiko
    CONNECTION SCIENCE, 2020, 32 (02) : 174 - 203
  • [35] New Algebraic Activation Function for Multi-Layered Feed Forward Neural Networks
    Babu, K. V. Naresh
    Edla, Damodar Reddy
    IETE JOURNAL OF RESEARCH, 2017, 63 (01) : 71 - 79
  • [36] Autoeoncoders and Information Augmentation for Improved Generalization and Interpretation in Multi-Layered Neural Networks
    Kamimura, Ryotaro
    2018 6TH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL AND BUSINESS INTELLIGENCE (ISCBI 2018), 2018, : 52 - 58
  • [37] Implementation of two-dimensional systolic algorithms for multi-layered neural networks
    Song, Q
    Kho, KP
    See, KH
    JOURNAL OF SYSTEMS ARCHITECTURE, 1999, 45 (14) : 1209 - 1218
  • [38] EXTRACTION OF RELATIONS BETWEEN LECTURER AND STUDENTS BY USING MULTI-LAYERED NEURAL NETWORKS
    Watanabe, Eiji
    Ozeki, Takashi
    Kohama, Takeshi
    IMAGAPP & IVAPP 2011: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON IMAGING THEORY AND APPLICATIONS AND INTERNATIONAL CONFERENCE ON INFORMATION VISUALIZATION THEORY AND APPLICATIONS, 2011, : 75 - 80
  • [39] Information-Theoretic Self-compression of Multi-layered Neural Networks
    Kamimura, Ryotaro
    THEORY AND PRACTICE OF NATURAL COMPUTING (TPNC 2018), 2018, 11324 : 401 - 413
  • [40] Evolving MIMO Multi-Layered Artificial Neural Networks Using Grammatical Evolution
    Ahmad, Qadeer
    Rafiq, Atif
    Raja, Muhammad Adil
    Javed, Noman
    SAC '19: PROCEEDINGS OF THE 34TH ACM/SIGAPP SYMPOSIUM ON APPLIED COMPUTING, 2019, : 1278 - 1285