A novel outlier detecting algorithm based on the outlier turning points

被引:13
|
作者
Huang, Jinlong [1 ]
Cheng, Dongdong [1 ]
Zhang, Sulan [1 ]
机构
[1] Yangtze Normal Univ, Coll Big Data & Intelligent Engn, Chongqing 408100, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Outlier detection; Local outliers; Outlier clusters; Outlier turning points; NATURAL NEIGHBORHOOD GRAPH; CLUSTER;
D O I
10.1016/j.eswa.2023.120799
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Outlier detection is one of the hot research in data mining, and has been applied to various fields such as network anomaly detection, image abnormal analysis, etc. In recent years, many outlier detecting algorithms have been proposed. However, these outlier detecting algorithms are hard to effectively detect global outliers, local outliers and outlier clusters at the same time. In this paper, we propose a novel outlier detecting algorithm based on the following ideas: (1) the density distribution should not be changed dramatically on local area; (2) the ratio of the number of k nearest neighbors and the number of reverse k nearest neighbors should not be very big. Based on above ideas, the proposed algorithm aims to find outlier turning points, then regards all outlier turning points and its sparse neighbors as outliers. Furthermore, the proposed algorithm use natural neighbors to obtain the neighborhood parameter k adaptively. The formal analysis and extensive experiments demonstrate that this technique can detect global outliers, local outliers and outlier clusters without neighborhood parameter k.
引用
收藏
页数:9
相关论文
共 50 条
  • [31] A novel fuzzy kernel clustering algorithm for outlier detection
    Zhang, Hongyi
    Wu, Qingtao
    Pu, Jiexin
    2007 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION, VOLS I-V, CONFERENCE PROCEEDINGS, 2007, : 2378 - 2382
  • [32] An outlier mining algorithm based on gini index
    1600, ICIC Express Letters Office, Tokai University, Kumamoto Campus, 9-1-1, Toroku, Kumamoto, 862-8652, Japan (07):
  • [33] An Outlier Detection Algorithm Based on Differential Privacy
    Shou, Zhaoyu
    Yan, Ye
    Zou, Fengbo
    FUZZY SYSTEMS AND DATA MINING V (FSDM 2019), 2019, 320 : 984 - 990
  • [34] An Outlier Detection Method Based on PageRank Algorithm
    Huang, Zhan
    Long, Shun
    Jiang, Yuying
    Chen, Qian
    PROCEEDINGS OF 2016 12TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND SECURITY (CIS), 2016, : 331 - 335
  • [35] CBOF: Cohesiveness-Based Outlier Factor A Novel Definition of Outlier-ness
    Joshi, Vineet
    Bhatnagar, Raj
    MACHINE LEARNING AND DATA MINING IN PATTERN RECOGNITION, MLDM 2014, 2014, 8556 : 175 - 189
  • [36] Outlier Detection Algorithm Based on Iterative Clustering
    古平
    罗辛
    杨瑞龙
    张程
    Journal of Donghua University(English Edition), 2015, 32 (04) : 554 - 558
  • [37] A new Algorithm for Outlier Detection based on Offset
    Zhang, Yue
    Liu, Jie
    Song, Bo
    FIFTH INTERNATIONAL CONFERENCE ON INFORMATION ASSURANCE AND SECURITY, VOL 2, PROCEEDINGS, 2009, : 3 - 6
  • [38] ERDOF: outlier detection algorithm based on entropy weight distance and relative density outlier factor
    Zhang Z.
    Liu W.
    Zhang Y.
    Deng Y.
    Wei M.
    Tongxin Xuebao/Journal on Communications, 2021, 42 (09): : 133 - 143
  • [39] Outlier detection algorithm based on k-nearest neighbors-local outlier factor
    Xu, He
    Zhang, Lin
    Li, Peng
    Zhu, Feng
    JOURNAL OF ALGORITHMS & COMPUTATIONAL TECHNOLOGY, 2022, 16
  • [40] A Novel Battery State of Health Estimation Method Based on Outlier Detection Algorithm
    Piao, Chang-hao
    Hu, Zi-hao
    Su, Ling
    Zhao, Jian-fei
    JOURNAL OF ELECTRICAL ENGINEERING & TECHNOLOGY, 2016, 11 (06) : 1802 - 1811