Large Iterative Multitier Ensemble Classifiers for Security of Big Data

被引:27
|
作者
Abawajy, Jemal H. [1 ]
Kelarev, Andrei [1 ]
Chowdhury, Morshed [1 ]
机构
[1] Deakin Univ, Sch Informat Technol, Burwood, Vic 3125, Australia
关键词
LIME classifiers; ensemble meta classifiers; random forest; big data; MALWARE; CHALLENGE;
D O I
10.1109/TETC.2014.2316510
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper introduces and investigates large iterative multitier ensemble (LIME) classifiers specifically tailored for big data. These classifiers are very large, but are quite easy to generate and use. They can be so large that it makes sense to use them only for big data. They are generated automatically as a result of several iterations in applying ensemble meta classifiers. They incorporate diverse ensemble meta classifiers into several tiers simultaneously and combine them into one automatically generated iterative system so that many ensemble meta classifiers function as integral parts of other ensemble meta classifiers at higher tiers. In this paper, we carry out a comprehensive investigation of the performance of LIME classifiers for a problem concerning security of big data. Our experiments compare LIME classifiers with various base classifiers and standard ordinary ensemble meta classifiers. The results obtained demonstrate that LIME classifiers can significantly increase the accuracy of classifications. LIME classifiers performed better than the base classifiers and standard ensemble meta classifiers.
引用
收藏
页码:352 / 363
页数:12
相关论文
共 50 条
  • [1] Experimental evaluation of ensemble classifiers for imbalance in Big Data
    Juez-Gil M.
    Arnaiz-González Á.
    Rodríguez J.J.
    García-Osorio C.
    Applied Soft Computing, 2021, 108
  • [2] An Ensemble approach to Big Data Security (Cyber Security)
    Hashmani, Manzoor Ahmed
    Jameel, Syed Muslim
    Ibrahim, Aidarus M.
    Zaffar, Maryam
    Raza, Kamran
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2018, 9 (09) : 75 - 77
  • [3] Hybrid Consensus Pruning of Ensemble Classifiers for Big Data Malware Detection
    Abawajy, Jemal H.
    Chowdhury, Morshed
    Kelarev, Andrei
    IEEE TRANSACTIONS ON CLOUD COMPUTING, 2020, 8 (02) : 398 - 407
  • [4] From Big to Smart Data: Iterative ensemble filter for noise filtering in Big Data classification
    Garcia-Gil, Diego
    Luque-Sanchez, Francisco
    Luengo, Julian
    Garcia, Salvador
    Herrera, Francisco
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2019, 34 (12) : 3260 - 3274
  • [5] A Big Data Architecture for Large Scale Security Monitoring
    Marchal, Samuel
    Jiang, Xiuyan
    State, Radu
    Engel, Thomas
    2014 IEEE INTERNATIONAL CONGRESS ON BIG DATA (BIGDATA CONGRESS), 2014, : 56 - 63
  • [6] The classification of imbalanced large data sets based on MapReduce and ensemble of ELM classifiers
    Junhai Zhai
    Sufang Zhang
    Chenxi Wang
    International Journal of Machine Learning and Cybernetics, 2017, 8 : 1009 - 1017
  • [7] The classification of imbalanced large data sets based on MapReduce and ensemble of ELM classifiers
    Zhai, Junhai
    Zhang, Sufang
    Wang, Chenxi
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2017, 8 (03) : 1009 - 1017
  • [8] Big data classification using heterogeneous ensemble classifiers in Apache Spark based on MapReduce paradigm
    Kadkhodaei, Hamidreza
    Moghadam, Amir Masoud Eftekhari
    Dehghan, Mehdi
    EXPERT SYSTEMS WITH APPLICATIONS, 2021, 183
  • [9] Educational Sustainability through Big Data Assimilation to Quantify Academic Procrastination Using Ensemble Classifiers
    Abidi, Syed Muhammad Raza
    Zhang, Wu
    Haidery, Saqib Ali
    Rizvi, Sanam Shahla
    Riaz, Rabia
    Ding, Hu
    Kwon, Se Jin
    SUSTAINABILITY, 2020, 12 (15)
  • [10] A Big Data Security Framework for IoT Networks Using Weighted Average Ensemble
    Hadj-Attou, Abdelkader
    Kabir, Yacine
    Ykhlef, Farid
    PROGRAM OF THE 2ND INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING AND AUTOMATIC CONTROL, ICEEAC 2024, 2024,