Stochastic parallel extreme artificial hydrocarbon networks: An implementation for fast and robust supervised machine learning in high-dimensional data

被引:17
|
作者
Ponce, Hiram [1 ]
de Campos Souza, Paulo V. [2 ]
Guimaraes, Augusto Junio [2 ]
Gonzalez-Mora, Guillermo [1 ]
机构
[1] Univ Panamer, Fac Ingn, Augusto Rodin 498, Mexico City 03920, DF, Mexico
[2] Fac UNA Betim, Av Gov Valadares 640, BR-32510010 Betim, MG, Brazil
关键词
Machine learning; Parallel computing; Extreme learning machines; Stochastic learning; Regression; Classification; Big data; PARTICLE SWARM OPTIMIZATION; GRADIENT DESCENT; ALGORITHMS;
D O I
10.1016/j.engappai.2019.103427
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Artificial hydrocarbon networks (AHN) a supervised learning method inspired on organic chemical structures and mechanisms - have shown improvements in predictive power and interpretability in comparison with other well-known machine learning models. However, AHN are very time-consuming that are not able to deal with large data until now. In this paper, we introduce the stochastic parallel extreme artificial hydrocarbon networks (SPE-AHN), an algorithm for fast and robust training of supervised AHN models in high-dimensional data. This training method comprises a population-based meta-heuristic optimization with defined individual encoding and objective function related to the AHN-model, an implementation in parallel-computing, and a stochastic learning approach for consuming large data. We conducted three experiments with synthetic and real data sets to validate the training execution time and performance of the proposed algorithm. Experimental results demonstrated that the proposed SPE-AHN outperforms the original-AHN method, increasing the speed of training more than 10,000x times in the worst case scenario. Additionally, we present two case studies in real data sets for solar-panel deployment prediction (regression problem), and human falls and daily activities classification in healthcare monitoring systems (classification problem). These case studies showed that SPE-AHN improves the state-of-the-art machine learning models in both engineering problems. We anticipate our new training algorithm to be useful in many applications of AHN like robotics, finance, medical engineering, aerospace, and others, in which large amounts of data (e.g. big data) is essential.
引用
收藏
页数:16
相关论文
共 50 条
  • [31] Revisiting Computational Thermodynamics through Machine Learning of High-Dimensional Data
    Srinivasan, Srikant
    Rajan, Krishna
    COMPUTING IN SCIENCE & ENGINEERING, 2013, 15 (05) : 22 - 31
  • [32] Novel machine learning approach for classification of high-dimensional microarray data
    Rabia Aziz Musheer
    C. K. Verma
    Namita Srivastava
    Soft Computing, 2019, 23 : 13409 - 13421
  • [33] Novel machine learning approach for classification of high-dimensional microarray data
    Musheer, Rabia Aziz
    Verma, C. K.
    Srivastava, Namita
    SOFT COMPUTING, 2019, 23 (24) : 13409 - 13421
  • [34] PERFORMANCE OF MACHINE LEARNING METHODS IN CLASSIFICATION MODELS WITH HIGH-DIMENSIONAL DATA
    Zekic-Susac, Marijana
    Pfeifer, Sanja
    Sarlija, Natasa
    SOR'13 PROCEEDINGS: THE 12TH INTERNATIONAL SYMPOSIUM ON OPERATIONAL RESEARCH IN SLOVENIA, 2013, : 219 - 224
  • [35] Robust reduced-order machine learning modeling of high-dimensional nonlinear processes using noisy data
    Tan, Wallace Gian Yion
    Xiao, Ming
    Wu, Zhe
    DIGITAL CHEMICAL ENGINEERING, 2024, 11
  • [36] Robust Classification of High-Dimensional Spectroscopy Data Using Deep Learning and Data Synthesis
    Houston, James
    Glavin, Frank G.
    Madden, Michael G.
    JOURNAL OF CHEMICAL INFORMATION AND MODELING, 2020, 60 (04) : 1936 - 1954
  • [37] Asynchronous Parallel Fuzzy Stochastic Gradient Descent for High-Dimensional Incomplete Data Representation
    Qin, Wen
    Luo, Xin
    IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2024, 32 (02) : 445 - 459
  • [38] Extreme Learning Machine with Harmony Search for High Dimensional Data Classifications
    Li, Sicheng
    Man, Zhihong
    Cao, Zhenwei
    Zheng, Jinchuan
    Chen, Yuan
    2021 INTERNATIONAL CONFERENCE ON ADVANCED MECHATRONIC SYSTEMS (ICAMECHS), 2021, : 56 - 60
  • [39] Outlier detection toward high-dimensional industrial data using extreme tensor-train learning machine with compression
    Deng, Xiaowu
    Shi, Yuanquan
    Yao, Dunhong
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2023, 35 (06)
  • [40] Avoiding overfitting in the analysis of high-dimensional data with artificial neural networks (ANNs)
    Defernez, M
    Kemsley, EK
    ANALYST, 1999, 124 (11) : 1675 - 1681