Impartial competitive learning in multi-layered neural networks

被引:0
|
作者
Kamimura, Ryotaro [1 ,2 ,3 ]
机构
[1] Tokai Univ, IT Educ Ctr, Hiratsuka, Kanagawa, Japan
[2] Kumamoto Drone Technol & Dev, Nishi Ku, Kamimatsuo, Kumamoto, Japan
[3] Kumamoto Drone Technol & Dev, Nishi Ku, Kamimatsuo, Kumamoto 8615289, Japan
关键词
Impartial; competitive learning; componential competition; computational competition; collective competition; cost; interpretation; MUTUAL INFORMATION; ENGLISH;
D O I
10.1080/09540091.2023.2174079
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The present paper aims to propose a new learning and interpretation method called "impartial competitive learning", meaning that all participants in a competition should be winners. Due to its importance, the impartiality is forced to be realised even by increasing the corresponding cost in terms of the strength of weights. For the first approximation, three types of impartial competition can be developed: componential, computational, and collective competition. In the componential competition, every weight should have an equal chance on average to win the competition. In the computational competition, all computational procedures should have an equal chance to be applied sequentially in learning. In collective computing for interpretation, all network configurations, obtained by learning, have an equal chance to participate in a process of interpretation, representing one of the most idealised forms of impartiality. The method was applied to a well-known second-language-learning data set. The intuitive conclusion, stressed in the specific science, could not be extracted by the conventional natural language processing methods, because they can deal only with word frequency. The present method tried to extract a main feature beyond the word frequency by competing connection weights and computational procedures impartially, followed by collective and impartial competition for interpretation.
引用
收藏
页数:33
相关论文
共 50 条
  • [1] Information theoretic competitive learning in multi-layered networks
    Kamimura, R
    ICONIP'02: PROCEEDINGS OF THE 9TH INTERNATIONAL CONFERENCE ON NEURAL INFORMATION PROCESSING: COMPUTATIONAL INTELLIGENCE FOR THE E-AGE, 2002, : 311 - 316
  • [2] Multi-Layered Neural Networks with Learning of Output Functions
    Ma, Lixin
    Miyajima, Hiromi
    Shigei, Noritaka
    INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2006, 6 (3A): : 140 - 145
  • [3] A structural learning algorithm for multi-layered neural networks
    Kotani, M
    Kajiki, A
    Akazawa, K
    1997 IEEE INTERNATIONAL CONFERENCE ON NEURAL NETWORKS, VOLS 1-4, 1997, : 1105 - 1110
  • [4] Serially Disentangled Learning for Multi-Layered Neural Networks
    Kamimura, Ryotaro
    Kitajima, Ryozo
    ADVANCES AND TRENDS IN ARTIFICIAL INTELLIGENCE: THEORY AND PRACTICES IN ARTIFICIAL INTELLIGENCE, 2022, 13343 : 669 - 681
  • [5] Learning characteristics of multi-layered higher order neural networks
    Ma, L.
    Miyajima, H.
    Shigei, N.
    Advances in Computational Methods in Sciences and Engineering 2005, Vols 4 A & 4 B, 2005, 4A-4B : 361 - 364
  • [6] Local Selective Learning for Interpreting Multi-Layered Neural Networks
    Kamimura, Ryotaro
    Kitajima, Ryozo
    Sakai, Hiroyuki
    2018 JOINT 10TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING AND INTELLIGENT SYSTEMS (SCIS) AND 19TH INTERNATIONAL SYMPOSIUM ON ADVANCED INTELLIGENT SYSTEMS (ISIS), 2018, : 115 - 122
  • [7] Information theoretic competitive learning in self-adaptive multi-layered networks
    Kamimura, R
    CONNECTION SCIENCE, 2003, 15 (01) : 3 - 26
  • [8] Supervised Semi-Autoencoder Learning for Multi-Layered Neural Networks
    Kamimura, Ryotaro
    Takeuchi, Haruhiko
    2017 JOINT 17TH WORLD CONGRESS OF INTERNATIONAL FUZZY SYSTEMS ASSOCIATION AND 9TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING AND INTELLIGENT SYSTEMS (IFSA-SCIS), 2017,
  • [9] Interpreting and Improving Multi-Layered Networks by Free Energy-Based Competitive Learning
    Kamimura, Ryotaro
    2008 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC), VOLS 1-6, 2008, : 1811 - 1817
  • [10] Teacher-directed learning: information-theoretic competitive learning in supervised multi-layered networks
    Kamimura, R
    Yoshida, F
    CONNECTION SCIENCE, 2003, 15 (2-3) : 117 - 140