Detection for Approximately Duplicate Records Based on Fuzzy Comprehensive Evaluation

被引：0
|
作者：
Zhou, Lijuan [1 ]
Xiao, Zhe [1 ]
机构：
[1] Hunan Univ Technol, Coll Sci & Technol, Zhuzhou 412008, Hunan, Peoples R China
来源：
ADVANCED DESIGN AND MANUFACTURING TECHNOLOGY III, PTS 1-4 | 2013年 / 397-400卷
关键词：
Approximately Duplicate Records; Attribute Weight; Fuzzy Comprehensive Evaluation; Record Grouping; Similarity;
D O I：
10.4028/www.scientific.net/AMM.397-400.2464
中图分类号：
TP39 [计算机的应用];
学科分类号：
081203 ; 0835 ;
摘要：
To solve the problem of attribute weight determination in the approximately duplicate records, we put forward a method based on fuzzy comprehensive evaluation to get attribute weight in data set. We first perform an analysis of the composition factors of attribute. Then we carry out an evaluation of their rank. Finally, we make a determination of the attribute weight using the fuzzy comprehensive evaluation method, on the basis of which the approximately duplicate records are detected. Theoretical analysis and experimental results show that the method can objectively determine all attributes weight, and effectively detect the approximately duplicate records in massive data set.
引用
收藏
页码：2464 / 2468
页数：5
相关论文
共 50 条
  • [31] Intrusion detection alert verification based on multi-level fuzzy comprehensive evaluation
    Mu, CP
    Huang, HK
    Tian, SF
    COMPUTATIONAL INTELLIGENCE AND SECURITY, PT 1, PROCEEDINGS, 2005, 3801 : 9 - 16
  • [32] Intrusion detection system alerts fusion based on fuzzy comprehensive evaluation and immune evolution
    Liu, Jiaomin
    Li, Yongzheng
    Meng, Junying
    Wang, Zhenzhou
    Journal of Computational Information Systems, 2013, 9 (04): : 1509 - 1516
  • [33] Fuzzy Comprehensive Evaluation Model based on SVM
    Xian Sidong
    IITSI 2009: SECOND INTERNATIONAL SYMPOSIUM ON INTELLIGENT INFORMATION TECHNOLOGY AND SECURITY INFORMATICS, 2009, : 97 - 100
  • [34] Comprehensive Evaluation of Food based on the Fuzzy Mathematics
    Huang, Beibei
    PROCEEDINGS OF THE 2016 INTERNATIONAL CONFERENCE ON EDUCATION, MANAGEMENT, COMPUTER AND SOCIETY, 2016, 37 : 1200 - 1203
  • [35] CAPP Based on Automatic Fuzzy Comprehensive Evaluation
    Tang, W.
    Gu, L. Z.
    FUNCTIONAL MANUFACTURING TECHNOLOGIES AND CEEUSRO I, 2010, 426-427 : 648 - 652
  • [36] Evaluation of ICT in Basic Education Based on Fuzzy Comprehensive Evaluation
    Chen, Jinhua
    Tang, Jing
    Jiang, Qin
    Wang, Yuxin
    2016 2ND IEEE INTERNATIONAL CONFERENCE ON COMPUTER AND COMMUNICATIONS (ICCC), 2016, : 856 - 859
  • [37] The evaluation of stadium status in China based on fuzzy comprehensive evaluation
    Zhang, Chunhua
    Computer Modelling and New Technologies, 2014, 18 (12): : 786 - 789
  • [38] Venture Capital Evaluation Based on Fuzzy Comprehensive Evaluation Method
    Yuan, Xiue
    Ma, Mingjing
    2014 INTERNATIONAL CONFERENCE ON BUSINESS AND FINANCE (BF 2014), 2014, 3 : 24 - 29
  • [39] Mental health evaluation model based on fuzzy comprehensive evaluation
    Li, Y. (liying7909@163.com), 1600, Springer Verlag (219 LNEE):
  • [40] Energy Internet Evaluation Based on Fuzzy Comprehensive Evaluation Method
    Li, Guo
    Xiang, Fang
    Shuang, Wu
    PROCEEDINGS OF 2020 IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND INFORMATION SYSTEMS (ICAIIS), 2020, : 611 - 616
12345