Efficiently mining frequent itemsets with compact FP-tree

被引:0
|
作者
Qin, LX [1 ]
Luo, P [1 ]
Shi, ZZ [1 ]
机构
[1] Chinese Acad Sci, Comp Technol Inst, Key Lab Intelligent Informat Proc, Beijing 100080, Peoples R China
来源
关键词
association rule; frequent patterns; compact FP-tree;
D O I
10.1007/0-387-23152-8_51
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
FP-growth algorithm is an efficient algorithm for mining frequent patterns. It scans database only twice and does not need to generate and test the candidate sets that is quite time consuming. The efficiency of the FP-growth algorithm outperforms previously developed algorithms. But, it must recursively generate huge number of conditional FP-trees that requires much more memory and costs more time. In this paper, we present an algorithm, CFPmine, that is inspired by several previous works. CFPmine algorithm combines several advantages of existing techniques. One is using constrained subtrees of a compact FP-tree to mine frequent pattern, so that it is doesn't need to construct conditional FP-trees in the mining process. Second is using an array-based technique to reduce the traverse time to the CFP-tree. And an unified memeory management is also implemented in the algorithm. The experimental evaluation shows that CFPmine algorithm is a high performance algorithm. It outperforms Apriori, Eclat and FP-growth and requires less memory than FP-growth.
引用
收藏
页码:397 / 406
页数:10
相关论文
共 50 条
  • [1] Mining frequent closed itemsets in a unidirectional FP-tree
    Wei, Q.
    Wang, X. J.
    Song, J. J.
    Jiang, B. Q.
    2008 PROCEEDINGS OF INFORMATION TECHNOLOGY AND ENVIRONMENTAL SYSTEM SCIENCES: ITESS 2008, VOL 2, 2008, : 604 - 610
  • [2] A new FP-Tree algorithm for mining frequent itemsets
    Li, YC
    Chang, CC
    CONTENT COMPUTING, PROCEEDINGS, 2004, 3309 : 266 - 277
  • [3] Mining maximal frequent itemsets using combined FP-tree
    Yan, YJ
    Li, ZJ
    Wang, T
    Chen, YX
    Chen, HW
    AI 2004: ADVANCES IN ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2004, 3339 : 475 - 487
  • [4] Mining of Global Maximum Frequent Itemsets Based on FP-tree
    He, Bo
    ADVANCED RESEARCH ON AUTOMATION, COMMUNICATION, ARCHITECTONICS AND MATERIALS, PTS 1 AND 2, 2011, 225-226 (1-2): : 342 - 345
  • [5] Dynamic FP-Tree Pruning for Concurrent Frequent Itemsets Mining
    Song, Wei
    Liu, Wenbo
    Li, Jinhong
    COMPUTATIONAL INTELLIGENCE AND INTELLIGENT SYSTEMS, 2012, 316 : 111 - 120
  • [6] Mining maximal frequent itemsets using the ordered FP-tree
    Yu, Hong
    Wang, Xiu-Kun
    Meng, Jun
    Kongzhi yu Juece/Control and Decision, 2007, 22 (05): : 520 - 524
  • [7] Fast mining maximal frequent itemsets; Based on FP-tree
    Yan, YJ
    Li, ZJ
    Chen, HW
    CONCEPTUAL MODELING - ER 2004, PROCEEDINGS, 2004, 3288 : 348 - 361
  • [8] The Mining Algorithm of Frequent Itemsets based on Mapreduce and FP-tree
    He, Bo
    Zhang, Hongyuan
    Pei, Jianhui
    2017 INTERNATIONAL CONFERENCE ON COMPUTER NETWORK, ELECTRONIC AND AUTOMATION (ICCNEA), 2017, : 108 - 111
  • [9] An Efficient Approach for Incremental Mining Fuzzy Frequent Itemsets with FP-Tree
    Huo, Weigang
    Fang, Xingjie
    Zhang, Zhiyuan
    INTERNATIONAL JOURNAL OF UNCERTAINTY FUZZINESS AND KNOWLEDGE-BASED SYSTEMS, 2016, 24 (03) : 367 - 386
  • [10] Mining maximal frequent itemsets in data streams based on FP-Tree
    Ao, Fujiang
    Yan, Yuejin
    Huang, Jian
    Huang, Kedi
    MACHINE LEARNING AND DATA MINING IN PATTERN RECOGNITION, PROCEEDINGS, 2007, 4571 : 479 - +