Positive and negative association rule mining in Hadoop's MapReduce environment

被引：13

作者：

Bagui, Sikha ^{[1
]}

Dhar, Probal Chandra ^{[1
]}

机构：

[1] Univ West Florida, Dept Comp Sci, Pensacola, FL 32514 USA

来源：

JOURNAL OF BIG DATA | 2019年 / 6卷 / 01期

关键词：

Positive association rule mining; Negative association rule mining; Hadoop; MapReduce; Apriori; Big data; Frequent itemset mining; Parallel environment; Hadoop's Distributed File System (HDFS);

D O I：

10.1186/s40537-019-0238-8

中图分类号：

TP301 [理论、方法];

学科分类号：

081202 ;

摘要：

In this paper, we present a Hadoop implementation of the Apriori algorithm. Using Hadoop's distributed and parallel MapReduce environment, we present an architecture to mine positive as well as negative association rules in big data using frequent itemset mining and the Apriori algorithm. We also analyze and present the results of a few optimization parameters in Hadoop's MapReduce environment as it relates to this algorithm. The results are presented based on the number of rules generated as well as the run-time efficiency. We find that, a higher amount of parallelization, which means larger block sizes, will increase the run-time efficiency of the Hadoop implementation of the Apriori algorithm.

引用

页数：16

共 50 条

[41] Clustering of Association Rules for Big Datasets using Hadoop MapReduce
Moahmmed, Salahadin A.
Alasow, Mohamed A.
El-Alfy, El-Sayed M.
INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2021, 12 (03) : 536 - 545
[42] Positive and Negative Association Rule Analysis in Health Care Database
Ramaraj, E.
Venkatesan, N.
INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2008, 8 (10): : 325 - 330
[43] An Incremental Association Rule Algorithm Based on MapReduce
Liu, Yong
Zheng, Jiecai
Li, Xueqing
3RD ANNUAL INTERNATIONAL CONFERENCE ON INFORMATION SYSTEM AND ARTIFICIAL INTELLIGENCE (ISAI2018), 2018, 1069
[44] RESEARCH AND APPLICATION OF ALGORITHM FOR MINING POSITIVE AND NEGATIVE ASSOCIATION RULES
Peng, Xushan
Wu, Yanyan
INTERNATIONAL SYMPOSIUM ON COMPUTER SCIENCE & TECHNOLOGY, PROCEEDINGS, 2009, : 438 - 440
[45] Mining positive and negative association rules:: An approach for confined rules
Antonie, ML
Zaïane, OR
KNOWLEDGE DISCOVERY IN DATABASES: PKDD 2004, PROCEEDINGS, 2004, 3202 : 27 - 38
[46] Mining positive and negative association rules from large databases
Cornelis, Chris
Yan, Peng
Zhang, Xing
Chen, Guoqing
2006 IEEE CONFERENCE ON CYBERNETICS AND INTELLIGENT SYSTEMS, VOLS 1 AND 2, 2006, : 152 - 157
[47] Variables interaction for mining negative and positive quantitative association rules
Alachaher, Leila Nemmiche
Limos, Sylvie Guillaume
ICTAI-2006: EIGHTEENTH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2006, : 82 - +
[48] MapReduce Framework Based Sequential Association Rule Mining with Deep Learning Enabled Classification in Retail Scenario
Matrouk, Khaled M.
Nalavade, Jagannath E.
Alhasen, Saeed
Chavan, Meena
Verma, Neha
CYBERNETICS AND SYSTEMS, 2025, 56 (02) : 147 - 169
[49] Association Rule Mining and Refinement Using Shared Memory Multiprocessor Environment
Asha, P.
Jebarajan, T.
ARTIFICIAL INTELLIGENCE AND EVOLUTIONARY ALGORITHMS IN ENGINEERING SYSTEMS, VOL 2, 2015, 325 : 105 - 117
[50] P-IOC-FPMine: an association rule mining algorithm for item constraints based on the MapReduce framework
Chu, Zenan
Wang, Wei
International Journal of Wireless and Mobile Computing, 2022, 23 (01): : 57 - 66

← 1 2 3 4 5 →