Stochastic parallel extreme artificial hydrocarbon networks: An implementation for fast and robust supervised machine learning in high-dimensional data

被引:17
|
作者
Ponce, Hiram [1 ]
de Campos Souza, Paulo V. [2 ]
Guimaraes, Augusto Junio [2 ]
Gonzalez-Mora, Guillermo [1 ]
机构
[1] Univ Panamer, Fac Ingn, Augusto Rodin 498, Mexico City 03920, DF, Mexico
[2] Fac UNA Betim, Av Gov Valadares 640, BR-32510010 Betim, MG, Brazil
关键词
Machine learning; Parallel computing; Extreme learning machines; Stochastic learning; Regression; Classification; Big data; PARTICLE SWARM OPTIMIZATION; GRADIENT DESCENT; ALGORITHMS;
D O I
10.1016/j.engappai.2019.103427
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Artificial hydrocarbon networks (AHN) a supervised learning method inspired on organic chemical structures and mechanisms - have shown improvements in predictive power and interpretability in comparison with other well-known machine learning models. However, AHN are very time-consuming that are not able to deal with large data until now. In this paper, we introduce the stochastic parallel extreme artificial hydrocarbon networks (SPE-AHN), an algorithm for fast and robust training of supervised AHN models in high-dimensional data. This training method comprises a population-based meta-heuristic optimization with defined individual encoding and objective function related to the AHN-model, an implementation in parallel-computing, and a stochastic learning approach for consuming large data. We conducted three experiments with synthetic and real data sets to validate the training execution time and performance of the proposed algorithm. Experimental results demonstrated that the proposed SPE-AHN outperforms the original-AHN method, increasing the speed of training more than 10,000x times in the worst case scenario. Additionally, we present two case studies in real data sets for solar-panel deployment prediction (regression problem), and human falls and daily activities classification in healthcare monitoring systems (classification problem). These case studies showed that SPE-AHN improves the state-of-the-art machine learning models in both engineering problems. We anticipate our new training algorithm to be useful in many applications of AHN like robotics, finance, medical engineering, aerospace, and others, in which large amounts of data (e.g. big data) is essential.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Two-stage extreme learning machine for high-dimensional data
    Liu, Peng
    Huang, Yihua
    Meng, Lei
    Gong, Siyuan
    Zhang, Guopeng
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2016, 7 (05) : 765 - 772
  • [2] Two-stage extreme learning machine for high-dimensional data
    Peng Liu
    Yihua Huang
    Lei Meng
    Siyuan Gong
    Guopeng Zhang
    International Journal of Machine Learning and Cybernetics, 2016, 7 : 765 - 772
  • [3] ROBUST CLASSIFICATION OF HIGH-DIMENSIONAL DATA USING ARTIFICIAL NEURAL NETWORKS
    SMITH, DJ
    BAILEY, TC
    MUNFORD, AG
    STATISTICS AND COMPUTING, 1993, 3 (02) : 71 - 81
  • [4] Fast Robust Correlation for High-Dimensional Data
    Raymaekers, Jakob
    Rousseeuw, Peter J.
    TECHNOMETRICS, 2021, 63 (02) : 184 - 198
  • [5] Robust safe semi-supervised learning framework for high-dimensional data classification
    Ma, Jun
    Zhu, Xiaolong
    AIMS MATHEMATICS, 2024, 9 (09): : 25705 - 25731
  • [6] Machine learning for high-dimensional dynamic stochastic economies
    Scheidegger, Simon
    Bilionis, Ilias
    JOURNAL OF COMPUTATIONAL SCIENCE, 2019, 33 : 68 - 82
  • [7] A Robust Supervised Variable Selection for Noisy High-Dimensional Data
    Kalina, Jan
    Schlenker, Anna
    BIOMED RESEARCH INTERNATIONAL, 2015, 2015
  • [8] Fast Supervised Hashing with Decision Trees for High-Dimensional Data
    Lin, Guosheng
    Shen, Chunhua
    Shi, Qinfeng
    van den Hengel, Anton
    Suter, David
    2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 1971 - 1978
  • [9] Survival Prediction with Extreme Learning Machine, Supervised Principal Components and Regularized Cox Models in High-Dimensional Survival Data by Simulation
    Turkis, Fulden Cantas
    Omurlu, Imran Kurt
    Ture, Mevlut
    GAZI UNIVERSITY JOURNAL OF SCIENCE, 2024, 37 (02): : 1004 - 1020
  • [10] Unsupervised and semi-supervised extreme learning machine with wavelet kernel for high dimensional data
    Nan Zhang
    Shifei Ding
    Memetic Computing, 2017, 9 : 129 - 139