An Improved Fuzzy C-Means Algorithm Based on MapReduce

被引：0
|
作者：
Yu, Qing [1 ]
Ding, Zhimin [1 ]
机构：
[1] Tianjin Univ Technol, Tianjin Key Lab Intelligence Comp & Network Secur, Tianjin, Peoples R China
来源：
2015 8TH INTERNATIONAL CONFERENCE ON BIOMEDICAL ENGINEERING AND INFORMATICS (BMEI) | 2015年
关键词：
Clustering; The Fuzzy C-means algorithm; a Max-min Principle; The Canopy algorithm; MapReduce;
D O I：
暂无
中图分类号：
R318 [生物医学工程];
学科分类号：
0831 ;
摘要：
In order to solve the problem that the Fuzzy C-Means algorithm is sensitive to the initial clustering center, we use the Canopy algorithm to carry out the quick and rough clustering. At the same time, to avoid the blindness of the Canopy algorithm, we put forward an improved Canopy-FCM algorithm based on a max-min principle. In allusion to the problem that the FCM algorithm has high time complexity, this article use the parallel computing frame of MapReduce to design and realize the improved Canopy-FCM algorithm. Experimental results show: the improved Canopy-FCM algorithm based on MapReduce has better clustering quality and running speed than the Canopy-FCM and the FCM algorithm based on MapReduce, and the improved Canopy-FCM algorithm based on Hadoop has better speed-up ratio than the Canopy-FCM based on the Standalone mode.
引用
收藏
页码：634 / 638
页数：5
相关论文
共 50 条
  • [1] MapReduce-based Fuzzy C-means Algorithm for Distributed Document Clustering
    Sardar T.H.
    Ansari Z.
    Journal of The Institution of Engineers (India): Series B, 2022, 103 (01) : 131 - 142
  • [2] MapReduce-based fuzzy c-means clustering algorithm: implementation and scalability
    Ludwig, Simone A.
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2015, 6 (06) : 923 - 934
  • [3] MapReduce-based fuzzy c-means clustering algorithm: implementation and scalability
    Simone A. Ludwig
    International Journal of Machine Learning and Cybernetics, 2015, 6 : 923 - 934
  • [4] An Improved Fuzzy C-means Clustering Algorithm
    Duan, Lingzi
    Yu, Fusheng
    Zhan, Li
    2016 12TH INTERNATIONAL CONFERENCE ON NATURAL COMPUTATION, FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY (ICNC-FSKD), 2016, : 1199 - 1204
  • [5] Improved fuzzy C-means algorithm based on density peak
    Xiang-yi Liu
    Jian-cong Fan
    Zi-wen Chen
    International Journal of Machine Learning and Cybernetics, 2020, 11 : 545 - 552
  • [6] Intrusion Detection Based on Improved Fuzzy C-means Algorithm
    Jiang, Wei
    Yao, Min
    Yan, Jun
    ISISE 2008: INTERNATIONAL SYMPOSIUM ON INFORMATION SCIENCE AND ENGINEERING, VOL 2, 2008, : 326 - +
  • [7] An improved fuzzy C-means clustering algorithm based on PSO
    Niu Q.
    Huang X.
    Journal of Software, 2011, 6 (05) : 873 - 879
  • [8] Improved fuzzy C-means algorithm based on density peak
    Liu, Xiang-yi
    Fan, Jian-cong
    Chen, Zi-wen
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2020, 11 (03) : 545 - 552
  • [9] A fuzzy c-means clustering algorithm based on improved quantum genetic algorithm
    Ye, An-Xin
    Jin, Yong-Xian
    International Journal of Database Theory and Application, 2016, 9 (01): : 227 - 236
  • [10] An Improved Fuzzy C-means Clustering Algorithm Based on Simulated Annealing
    Liu, Peiyu
    Duan, Linshan
    Chi, Xuezhi
    Zhu, Zhenfang
    2013 10TH INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY (FSKD), 2013, : 39 - 43
12345