A Domain Adaptive Density Clustering Algorithm for Data With Varying Density Distribution

被引:50
|
作者
Chen, Jianguo [1 ]
Yu, Philip S. [2 ,3 ]
机构
[1] Hunan Univ, Coll Comp Sci & Elect Engn, Changsha 410082, Hunan, Peoples R China
[2] Univ Illinois, Dept Comp Sci, Chicago, IL 60607 USA
[3] Tsinghua Univ, Inst Data Sci, Beijing 100084, Peoples R China
基金
美国国家科学基金会;
关键词
Cluster fragmentation; density-peak clustering; domain-adaptive density clustering; varying density distribution;
D O I
10.1109/TKDE.2019.2954133
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As one type of efficient unsupervised learning methods, clustering algorithms have been widely used in data mining and knowledge discovery with noticeable advantages. However, clustering algorithms based on density peak have limited clustering effect on data with varying density distribution (VDD), equilibrium distribution (ED), and multiple domain-density maximums (MDDM), leading to the problems of sparse cluster loss and cluster fragmentation. To address these problems, we propose a Domain-Adaptive Density Clustering (DADC) algorithm, which consists of three steps: domain-adaptive density measurement, cluster center self-identification, and cluster self-ensemble. For data with VDD features, clusters in sparse regions are often neglected by using uniform density peak thresholds, which results in the loss of sparse clusters. We define a domain-adaptive density measurement method based on K-Nearest Neighbors (KNN) to adaptively detect the density peaks of different density regions. We treat each data point and its KNN neighborhood as a subgroup to better reflect its density distribution in a domain view. In addition, for data with ED or MDDM features, a large number of density peaks with similar values can be identified, which results in cluster fragmentation. We propose a cluster center self-identification and cluster self-ensemble method to automatically extract the initial cluster centers and merge the fragmented clusters. Experimental results demonstrate that compared with other comparative algorithms, the proposed DADC algorithm can obtain more reasonable clustering results on data with VDD, ED and MDDM features. Benefitting from a few parameter requirement and non-iterative nature, DADC achieves low computational complexity and is suitable for large-scale data clustering.
引用
收藏
页码:2310 / 2321
页数:12
相关论文
共 50 条
  • [21] Adaptive density distribution inspired affinity propagation clustering
    Zheyi Fan
    Jiao Jiang
    Shuqin Weng
    Zhonghang He
    Zhiwen Liu
    Neural Computing and Applications, 2019, 31 : 435 - 445
  • [22] Adaptive density distribution inspired affinity propagation clustering
    Fan, Zheyi
    Jiang, Jiao
    Weng, Shuqin
    He, Zhonghang
    Liu, Zhiwen
    NEURAL COMPUTING & APPLICATIONS, 2019, 31 (Suppl 1): : 435 - 445
  • [23] Multi-Density Adaptive Trajectory Clustering Algorithm for Ships Based on AIS Data
    Zhang, Yingjian
    Yuan, Xiaoyu
    Li, Meng
    Zhao, Guang
    Wang, Hongbo
    IEEE ACCESS, 2023, 11 : 108198 - 108210
  • [24] Fast Density Clustering Algorithm for Numerical Data and Categorical Data
    Chen Jinyin
    He Huihao
    Chen Jungan
    Yu Shanqing
    Shi Zhaoxia
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2017, 2017
  • [25] A domain density peak clustering algorithm based on natural neighbor
    Chen, Di
    Du, Tao
    Zhou, Jin
    Shen, Tianyu
    INTELLIGENT DATA ANALYSIS, 2023, 27 (02) : 443 - 462
  • [26] THE CLUSTERING ALGORITHM OF EVOLUTIONAL DATA STREAM BASED ON DENSITY
    Meng, Yuyu
    Zheng, Liying
    3RD INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY AND COMPUTER SCIENCE (ITCS 2011), PROCEEDINGS, 2011, : 473 - 477
  • [27] A novel density peaks clustering algorithm for mixed data
    Du, Mingjing
    Ding, Shifei
    Xue, Yu
    PATTERN RECOGNITION LETTERS, 2017, 97 : 46 - 53
  • [28] Quick clustering algorithm for wargaming data based on density
    Shi C.-L.
    Zhang M.-J.
    Wu L.
    Tang Y.-B.
    Jing M.
    Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2011, 33 (11): : 2428 - 2433
  • [29] IMPROVED DENSITY BASED ALGORITHM FOR DATA STREAM CLUSTERING
    Mousavi, Maryam
    Abu Bakar, Azuraliza
    JURNAL TEKNOLOGI, 2015, 77 (18): : 73 - 77
  • [30] An Efficient Density-Based Algorithm for Data Clustering
    Theljani, Foued
    Laabidi, Kaouther
    Zidi, Salah
    Ksouri, Moufida
    INTERNATIONAL JOURNAL ON ARTIFICIAL INTELLIGENCE TOOLS, 2017, 26 (04)