Distributed frequent subgraph mining on evolving graph using SPARK

被引:3
|
作者
Senthilselvan, N. [1 ]
Subramaniyaswamy, V. [1 ]
Vijayakumar, V. [2 ]
Karimi, Hamid Reza [3 ]
Aswin, N. [1 ]
Ravi, Logesh [4 ]
机构
[1] SASTRA Deemed Univ, Sch Comp, Thanjavur, India
[2] Univ New South Wales, Sch Comp Sci & Engn, Sydney, NSW, Australia
[3] Politecn Milan, Dept Mech Engn, Milan, Italy
[4] Sri Ramachandra Inst Higher Educ & Res, Sri Ramachandra Fac Engn & Technol, Chennai, Tamil Nadu, India
关键词
ALGORITHM; PATTERNS;
D O I
10.3233/IDA-194601
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Within the graph mining context, frequent subgraph identification plays a key role in retrieving required information or patterns from the huge amount of data in a short period. The problem of finding frequent items in traditional mining changed to the innovation of subgraphs that recurrently occurs in graph datasets containing a single huge graph. Majority of the existing methods target static graphs, and the distributed solution for dynamic graphs has not been explored. But, in modern applications like Facebook, robotics utilizes large evolving graphs. The goal is to design a method to find recurrent subgraphs from a single large evolving graph. In this research paper, a novel approach is proposed called DFSME, which uses SPARK to discover frequent subgraphs from an evolving graph in a distributed environment. DFSME maintains a set of subgraphs between frequent and infrequent subgraphs, which is used to decrease the search space. Our experiments with synthetic and real-world datasets authorize the effectiveness of DFSME for mining of recurrent subgraphs from huge evolving graph datasets. © 2020 - IOS Press and the authors. All rights reserved.
引用
收藏
页码:495 / 513
页数:19
相关论文
共 50 条
  • [31] A Distributed Frequent Itemset Mining Algorithm Based on Spark
    Gui, Feng
    Ma, Yunlong
    Zhang, Feng
    Liu, Min
    Li, Fei
    Shen, Weiming
    Bai, Hua
    PROCEEDINGS OF THE 2015 IEEE 19TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN (CSCWD), 2015, : 271 - 275
  • [32] A distributed frequent itemset mining algorithm using Spark for Big Data analytics
    Feng Zhang
    Min Liu
    Feng Gui
    Weiming Shen
    Abdallah Shami
    Yunlong Ma
    Cluster Computing, 2015, 18 : 1493 - 1501
  • [33] A distributed frequent itemset mining algorithm using Spark for Big Data analytics
    Zhang, Feng
    Liu, Min
    Gui, Feng
    Shen, Weiming
    Shami, Abdallah
    Ma, Yunlong
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2015, 18 (04): : 1493 - 1501
  • [34] TIPTAP: Approximate Mining of Frequent k-Subgraph Patterns in Evolving Graphs
    Nasir, Muhammad Anis Uddin
    Aslay, Cigdem
    Morales, Gianmarco De Francisci
    Riondato, Matteo
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2021, 15 (03)
  • [35] Generalization for frequent subgraph mining
    Inokuchi, Akihiro
    Washio, Takashi
    Motoda, Hiroshi
    Transactions of the Japanese Society for Artificial Intelligence, 2004, 19 (05) : 368 - 378
  • [36] DIMSpan - Transactional Frequent Subgraph Mining with Distributed In -Memory Dataflow Systems
    Petermann, Andre
    Junghanns, Martin
    Rahm, Erhard
    BDCAT'17: PROCEEDINGS OF THE FOURTH IEEE/ACM INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING, APPLICATIONS AND TECHNOLOGIES, 2017, : 237 - 246
  • [37] Frequent Subgraph Mining on BigData
    Sreedevi, K. M.
    Hareesh, M. J.
    Kunjachan, Honeytta
    PROCEEDINGS OF THE 2018 SECOND INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING AND CONTROL SYSTEMS (ICICCS), 2018, : 555 - 560
  • [38] Frequent mining of subgraph structures
    Guo, Ping
    Wang, Xin-Ru
    Kang, Yan-Rong
    JOURNAL OF EXPERIMENTAL & THEORETICAL ARTIFICIAL INTELLIGENCE, 2006, 18 (04) : 513 - 521
  • [39] Topic Discovery Using Frequent Subgraph Mining Approach
    Tri Nguyen
    Phuc Do
    COMPUTATIONAL SCIENCE AND TECHNOLOGY, ICCST 2017, 2018, 488 : 432 - 442
  • [40] Mining Top-K Frequent Correlated Subgraph Pairs in Graph Databases
    Shang, Li
    Jian, Yujiao
    INTELLIGENT INFORMATICS, 2013, 182 : 1 - 8