A novel outlier detecting algorithm based on the outlier turning points

被引:13
|
作者
Huang, Jinlong [1 ]
Cheng, Dongdong [1 ]
Zhang, Sulan [1 ]
机构
[1] Yangtze Normal Univ, Coll Big Data & Intelligent Engn, Chongqing 408100, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Outlier detection; Local outliers; Outlier clusters; Outlier turning points; NATURAL NEIGHBORHOOD GRAPH; CLUSTER;
D O I
10.1016/j.eswa.2023.120799
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Outlier detection is one of the hot research in data mining, and has been applied to various fields such as network anomaly detection, image abnormal analysis, etc. In recent years, many outlier detecting algorithms have been proposed. However, these outlier detecting algorithms are hard to effectively detect global outliers, local outliers and outlier clusters at the same time. In this paper, we propose a novel outlier detecting algorithm based on the following ideas: (1) the density distribution should not be changed dramatically on local area; (2) the ratio of the number of k nearest neighbors and the number of reverse k nearest neighbors should not be very big. Based on above ideas, the proposed algorithm aims to find outlier turning points, then regards all outlier turning points and its sparse neighbors as outliers. Furthermore, the proposed algorithm use natural neighbors to obtain the neighborhood parameter k adaptively. The formal analysis and extensive experiments demonstrate that this technique can detect global outliers, local outliers and outlier clusters without neighborhood parameter k.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] A density-based local outlier detecting algorithm
    Hu, Caiping
    Qin, Xiaolin
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2010, 47 (12): : 2110 - 2116
  • [2] An Optimized Pruning-based Outlier Detecting algorithm
    Wang, Jinghua
    Zhao, Xinxiang
    Jin, Peng
    Zhang, Guoyan
    INFORMATION TECHNOLOGY APPLICATIONS IN INDUSTRY II, PTS 1-4, 2013, 411-414 : 1076 - 1080
  • [3] A Novel Algorithm for Detecting Spatial-Temporal Trajectory Outlier
    Lv, Shenglan
    Zhang, Yifan
    Ji, Genlin
    Zhao, Bin
    PROCEEDINGS OF THE 2016 INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND ELECTRONIC TECHNOLOGY, 2016, 48 : 184 - 190
  • [4] A Novel Cluster Based Algorithm for Outlier Detection
    Mahajan, Manish
    Kumar, Santosh
    Pant, Bhasker
    COMPUTING, COMMUNICATION AND SIGNAL PROCESSING, ICCASP 2018, 2019, 810 : 449 - 456
  • [5] A novel algorithm for outlier removal based on density
    Wang Y.
    Zidonghua Xuebao/ Acta Automatica Sinica, 2010, 36 (02): : 343 - 346
  • [6] An outlier detection algorithm based on an integrated outlier factor
    Zhou, Hongfang
    Liu, Hongjiang
    Zhang, Yingjie
    Zhang, Yao
    INTELLIGENT DATA ANALYSIS, 2019, 23 (05) : 975 - 990
  • [7] A Novel Data Purification Algorithm Based On Outlier Mining
    Dong, Jianfeng
    Wang, Xiaofeng
    Hu, Feng
    Xiao, Liyan
    HIS 2009: 2009 NINTH INTERNATIONAL CONFERENCE ON HYBRID INTELLIGENT SYSTEMS, VOL 3, PROCEEDINGS, 2009, : 95 - +
  • [8] A sequential outlier detecting method using a clustering algorithm
    Seo, Han Son
    Yoon, Min
    KOREAN JOURNAL OF APPLIED STATISTICS, 2016, 29 (04) : 699 - 706
  • [9] A novel spatial outlier detection algorithm based on Mahalanobis distance
    Wen, Junhao
    Wu, Hongyan
    Wu, Zhongfu
    DYNAMICS OF CONTINUOUS DISCRETE AND IMPULSIVE SYSTEMS-SERIES B-APPLICATIONS & ALGORITHMS, 2006, 13E : 3574 - 3577
  • [10] Cell-based outlier detection algorithm: A fast outlier detection algorithm for large datasets
    Wan, You
    Bian, Fuling
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PROCEEDINGS, 2008, 5012 : 1042 - 1048