Complex query processing in large-scale distributed system

被引:0
|
作者
Zhou, Ao-Ying [1 ,2 ]
Zhou, Min-Qi [2 ]
Qian, Wei-Ning [1 ]
Zhang, Rong [2 ]
机构
[1] Institute of Massive Computing, East China Normal University, Shanghai 200062, China
[2] Department of Computer Science and Engineering, Fudan University, Shanghai 200433, China
来源
关键词
Complex networks - Efficiency - Distributed computer systems - Overlay networks - Peer to peer networks;
D O I
10.3724/sp.j.1016.2008.01563
中图分类号
学科分类号
摘要
Complex query processing in large-scale distributed systems is an important problem in bringing peer-to-peer techniques into applications. It has attracted much attention in both academic and industrial community. This paper presents a generalized Chord-like technique, GChord, for evaluating queries with multi-attributes with scalability and efficiency. GChord supports not only exact match queries but also range queries. It has advantages over existing methods in that each tuple is only encoded and indexed once, while the query efficiency is guaranteed. Thus, index maintenance cost and search efficiency are balanced. Additional optimization techniques further improve the performance of GChord. Extensive experiments are conducted to validate the efficiency of the proposed method.
引用
收藏
页码:1563 / 1572
相关论文
共 50 条
  • [1] Lightweight Distributed Execution Engine for Large-Scale Spatial Join Query Processing
    Zhang, Jianting
    You, Simin
    Gruenwald, Le
    2015 IEEE INTERNATIONAL CONGRESS ON BIG DATA - BIGDATA CONGRESS 2015, 2015, : 150 - 157
  • [2] Large-scale data modeling in Hive and distributed query processing using Mapreduce and Tez
    Adamov, Abzetdin
    DIVAI 2018: 12TH INTERNATIONAL SCIENTIFIC CONFERENCE ON DISTANCE LEARNING IN APPLIED INFORMATICS, 2018, : 389 - 404
  • [3] On Distributed Deep Network for Processing Large-Scale Sets of Complex Data
    Qin Chao
    Gao Xiao-guang
    Chen Da-qing
    2016 8TH INTERNATIONAL CONFERENCE ON INTELLIGENT HUMAN-MACHINE SYSTEMS AND CYBERNETICS (IHMSC), VOL. 1, 2016, : 395 - 399
  • [4] Incremental Techniques for Large-Scale Dynamic Query Processing
    Elghandour, Iman
    Kara, Ahmet
    Olteanu, Dan
    Vansummeren, Stijn
    CIKM'18: PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, 2018, : 2297 - 2298
  • [5] A survey of large-scale analytical query processing in MapReduce
    Doulkeridis, Christos
    Norvag, Kjetil
    VLDB JOURNAL, 2014, 23 (03): : 355 - 380
  • [6] A survey of large-scale analytical query processing in MapReduce
    Christos Doulkeridis
    Kjetil Nørvåg
    The VLDB Journal, 2014, 23 : 355 - 380
  • [7] Large-Scale Spatial Join Query Processing in Cloud
    You, Simin
    Zhang, Jianting
    Gruenwald, Le
    2015 13TH IEEE INTERNATIONAL CONFERENCE ON DATA ENGINEERING WORKSHOPS (ICDEW), 2015, : 34 - 41
  • [8] Spangle: A Distributed In-Memory Processing System for Large-Scale Arrays
    Kim, Sangchul
    Kim, Bogyeong
    Moon, Bongki
    2021 IEEE 37TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2021), 2021, : 1799 - 1810
  • [9] Distributed large-scale graph processing on FPGAs
    Sahebi, Amin
    Barbone, Marco
    Procaccini, Marco
    Luk, Wayne
    Gaydadjiev, Georgi
    Giorgi, Roberto
    JOURNAL OF BIG DATA, 2023, 10 (01)
  • [10] Distributed large-scale graph processing on FPGAs
    Amin Sahebi
    Marco Barbone
    Marco Procaccini
    Wayne Luk
    Georgi Gaydadjiev
    Roberto Giorgi
    Journal of Big Data, 10