Parallel co-location mining with MapReduce and NoSQL systems

被引:16
|
作者
Yoo, Jin Soung [1 ]
Boulware, Douglas [2 ]
Kimmey, David [1 ]
机构
[1] Purdue Univ Ft Wayne, Dept Comp Sci, Ft Wayne, IN 46805 USA
[2] Air Force Res Lab, Rome Res Site, New York, NY USA
关键词
Spatial data mining; Parallel co-location mining; Cloud computing; MapReduce; NoSQL; COLOCATION PATTERNS; DATA SETS; FRAMEWORK;
D O I
10.1007/s10115-019-01381-y
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the rapid growth of georeferenced data, large-scale data processing and analysis methods are needed for spatial big data. Spatial co-location pattern mining is an interesting and important issue in spatial data mining area which discovers the subsets of features whose objects are frequently located together in geographic proximity. There are several works for efficiently processing co-location pattern discovery; however, they may be insufficient for large dense spatial data because the mining task takes up a lot of processing time and memory. In this work, we leveraged the power of a modern distributed computing platform, Hadoop, and developed an algorithm (called ParColoc) for parallel co-location mining on the MapReduce framework. This study explored challenge issues in designing the parallel co-location mining algorithm and solved them with adopting a spatial declusteirng technique and a NoSQL system. We conducted an experimental evaluation with real-world data and synthetic data to examine the effectiveness of proposed methods. The experiment result shows that ParColoc is a promising method for parallel co-location mining in cloud computing environment.
引用
收藏
页码:1433 / 1463
页数:31
相关论文
共 50 条
  • [41] Spatial co-location pattern mining based on graph structure
    Wang J.
    Ai T.
    Wu H.
    Xu H.
    Li G.
    Cehui Xuebao/Acta Geodaetica et Cartographica Sinica, 2024, 53 (04): : 724 - 735
  • [42] Mining Spatial Co-Location Patterns With a Mixed Prevalence Measure
    Yang, Peizhong
    Wang, Lizhen
    Zhou, Lihua
    Chen, Hongmei
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (06) : 7845 - 7859
  • [43] A framework of spatial co-location pattern mining for ubiquitous GIS
    Seung Kwan Kim
    Jee Hyung Lee
    Keun Ho Ryu
    Ungmo Kim
    Multimedia Tools and Applications, 2014, 71 : 199 - 218
  • [44] The Effect of Spatial Autocorrelation on Spatial Co-Location Pattern Mining
    Duan, Jiangli
    Wang, Lizhen
    Hu, Xin
    2017 INTERNATIONAL CONFERENCE ON COMPUTER, INFORMATION AND TELECOMMUNICATION SYSTEMS (IEEE CITS), 2017, : 210 - 214
  • [45] On the relationships between clustering and spatial co-location pattern mining
    Huang, Yan
    Zhang, Pusheng
    ICTAI-2006: EIGHTEENTH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2006, : 513 - +
  • [46] Co-location Pattern Mining Under the Spatial Structure Constraint
    Govan, Rodrigue
    Selmaoui-Folcher, Nazha
    Giannakos, Aristotelis
    Fournier-Viger, Philippe
    DATABASE AND EXPERT SYSTEMS APPLICATIONS, DEXA 2023, PT I, 2023, 14146 : 186 - 193
  • [47] Spatial co-location rule mining research in continuous data
    Wang, Zhan-Quan
    Chen, Hai-Bo
    Yu, Hui-Qun
    PROCEEDINGS OF 2006 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2006, : 1362 - +
  • [48] RCP Mining: Towards the Summarization of Spatial Co-location Patterns
    Liu, Bozhong
    Chen, Ling
    Liu, Chunyang
    Zhang, Chengqi
    Qiu, Weidong
    ADVANCES IN SPATIAL AND TEMPORAL DATABASES (SSTD 2015), 2015, 9239 : 451 - 469
  • [49] Co-location pattern mining using approximate Euclidean measure
    Andrzejewski, W.
    Boinski, P.
    INFORMATION SCIENCES, 2025, 706
  • [50] A framework of spatial co-location pattern mining for ubiquitous GIS
    Kim, Seung Kwan
    Lee, Jee Hyung
    Ryu, Keun Ho
    Kim, Ungmo
    MULTIMEDIA TOOLS AND APPLICATIONS, 2014, 71 (01) : 199 - 218