Exploiting fuzzy rough entropy to detect anomalies

被引:2
|
作者
Wang, Sihan [1 ]
Yuan, Zhong [1 ]
Luo, Chuan [1 ]
Chen, Hongmei [2 ]
Peng, Dezhong [1 ,3 ]
机构
[1] Sichuan Univ, Coll Comp Sci, Chengdu 610065, Peoples R China
[2] Southwest Jiaotong Univ, Sch Comp & Artificial Intelligence, Chengdu 611756, Peoples R China
[3] Chengdu Ruibei Yingte Informat Technol Co Ltd, Chengdu 610054, Peoples R China
基金
中国国家自然科学基金;
关键词
Anomaly detection; Outlier detection; Fuzzy rough entropy; Uncertainty measure; Mixed data; OUTLIER DETECTION;
D O I
10.1016/j.ijar.2023.109087
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Anomaly detection has been used in a wide range of fields. However, most of the current detection methods are only applicable to certain data, ignoring uncertain information such as fuzziness in the data. Fuzzy rough set theory, as an essential mathematical model for granular computing, provides an effective method for processing uncertain data such as fuzziness. Fuzzy rough entropy has been proposed in fuzzy rough set theory and has been employed successfully in data analysis tasks such as feature selection. However, it mainly uses the intersection operation, which may not effectively reflect the similarity between high-dimensional objects. In response to the two challenges mentioned above, distance-based fuzzy rough entropy and its correlation measures are proposed. Further, the proposed fuzzy rough entropy is used to construct the anomaly detection model and the Fuzzy Rough Entropy-based Anomaly Detection (FREAD) algorithm is designed. Finally, the FREAD algorithm is compared and analyzed with some mainstream anomaly detection algorithms (including COF, DIS, INFLO, LDOF, LoOP, MIX, ODIN, SRO, and VarE algorithms) on some publicly available datasets. Experimental results indicate that the FREAD algorithm significantly outperforms other algorithms in terms of performance and flexibility. The code is publicly available online at https://github .com /optimusprimeyy /FREAD.
引用
收藏
页数:18
相关论文
共 50 条
  • [31] Entropy-based fuzzy rough classification approach for extracting classification rules
    Tsai, Ying-Chieh
    Cheng, Ching-Hsue
    Chang, Jing-Rong
    EXPERT SYSTEMS WITH APPLICATIONS, 2006, 31 (02) : 436 - 443
  • [32] DETECT SPINDLE ANOMALIES
    Schnepf, Ken
    Cutting Tool Engineering, 2020, 72 (07):
  • [33] Improving SMOTE with Fuzzy Rough Prototype Selection to Detect Noise in Imbalanced Classification Data
    Verbiest, Nele
    Ramentol, Enislay
    Cornelis, Chris
    Herrera, Francisco
    ADVANCES IN ARTIFICIAL INTELLIGENCE - IBERAMIA 2012, 2012, 7637 : 169 - 178
  • [34] ROUGH FUZZY-SETS AND FUZZY ROUGH SETS
    DUBOIS, D
    PRADE, H
    INTERNATIONAL JOURNAL OF GENERAL SYSTEMS, 1990, 17 (2-3) : 191 - 209
  • [35] The information entropy, rough entropy and knowledge granulation in rough set theory
    Liang, JY
    Shi, ZZ
    INTERNATIONAL JOURNAL OF UNCERTAINTY FUZZINESS AND KNOWLEDGE-BASED SYSTEMS, 2004, 12 (01) : 37 - 46
  • [36] Dynamic Shannon entropy (DySEn): a novel method to detect the local anomalies of complex time series
    Jiayi He
    Jinzhao Liu
    Pengjian Shang
    Yali Zhang
    Nonlinear Dynamics, 2021, 104 : 4007 - 4022
  • [37] Dynamic Shannon entropy (DySEn): a novel method to detect the local anomalies of complex time series
    He, Jiayi
    Liu, Jinzhao
    Shang, Pengjian
    Zhang, Yali
    NONLINEAR DYNAMICS, 2021, 104 (04) : 4007 - 4022
  • [38] A novel fuzzy-rough attribute reduction approach via local information entropy
    Xie, Linlin
    Lin, Guoping
    Li, Jinjin
    Lin, Yidong
    FUZZY SETS AND SYSTEMS, 2023, 473
  • [39] Rough Relational Operators and Rough Entropy in Rough Relational Database
    Jiang, Feng
    Liu, Guozhu
    WKDD: 2009 SECOND INTERNATIONAL WORKSHOP ON KNOWLEDGE DISCOVERY AND DATA MINING, PROCEEDINGS, 2009, : 761 - 764
  • [40] Fuzzy rough & rough fuzzy inference engines: for medical applications
    Chandana, Sandeep
    Mayorga, Rene V.
    2006 CANADIAN CONFERENCE ON ELECTRICAL AND COMPUTER ENGINEERING, VOLS 1-5, 2006, : 1134 - +