An Efficient and Distributed Framework for Real-Time Trajectory Stream Clustering

被引:5
|
作者
Gao, Yunjun [1 ]
Fang, Ziquan [1 ]
Xu, Jiachen [1 ]
Gong, Shenghao [1 ]
Shen, Chunhui [2 ,3 ]
Chen, Lu [1 ]
机构
[1] Zhejiang Univ, Hangzhou 310027, Zhejiang, Peoples R China
[2] Alibaba Grp, Hangzhou 310052, Zhejiang, Peoples R China
[3] AZFT Lab, Hangzhou 310007, Zhejiang, Peoples R China
关键词
Trajectory; Real-time systems; Clustering algorithms; Market research; Scalability; Behavioral sciences; Measurement; DBSCAN; distributed online processing; grid partitioning; trajectory stream clustering; SIMPLIFICATION;
D O I
10.1109/TKDE.2023.3312319
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the explosive ubiquity of GPS-equipped devices, e.g., mobile phones, vehicles, and vessels, a massive amount of real-time, unbounded, and varying-sampling trajectory streams are being generated continuously. Clustering trajectory streams is useful in real-life applications, such as traffic congestion prediction, crowd flow detection, and moving behavior study. Although several sliding-window based algorithms (that adopt the classic two-phases online-offline processing framework) are proposed for trajectory stream clustering, three challenges exist to meet ever-increasing application demands for effective, efficient, and scalable online clustering: i) How to effectively model unbounded trajectory streams in the online settings for effective clustering? ii) How to achieve truly real-time online processing? iii) How to improve the scalable capability of the clustering algorithm to support large-scale moving trajectory streams? In this paper, we propose an efficient and distributed trajectory stream clustering framework that can: i) model trajectory streams dynamically and effectively in a self-adaptive manner, i.e., k-Segment, which considers both spatial and temporal aspects of trajectory streams, ii) support distributed indexing, processing, and workload balance, and iii) incrementally cluster trajectory streams in an efficient manner. Experiments on a wide range of real-world trajectory datasets show that our framework outperforms state-of-the-art baselines in terms of clustering quality, efficiency, and scalability.
引用
收藏
页码:1857 / 1873
页数:17
相关论文
共 50 条
  • [41] Online Real-Time Trajectory Analysis Based on Adaptive Time Interval Clustering Algorithm
    Li, Jianjiang
    Jiao, Huihui
    Wang, Jie
    Liu, Zhiguo
    Wu, Jie
    BIG DATA MINING AND ANALYTICS, 2020, 3 (02) : 131 - 142
  • [42] RASP: Real-time Network Analytics with Distributed NoSQL Stream Processing
    Touloupas, Georgios
    Konstantinou, Ioannis
    Koziris, Nectarios
    2017 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2017, : 2414 - 2419
  • [43] Mobile Storm: Distributed Real-time Stream Processing for Mobile Clouds
    Ning, Qian
    Chen, Chien-An
    Stoleru, Radu
    Chen, Congcong
    2015 IEEE 4TH INTERNATIONAL CONFERENCE ON CLOUD NETWORKING (CLOUDNET), 2015, : 139 - 145
  • [44] TAM - A FORMAL FRAMEWORK FOR THE DEVELOPMENT OF DISTRIBUTED REAL-TIME SYSTEMS
    SCHOLEFIELD, DJ
    ZEDAN, HSM
    LECTURE NOTES IN COMPUTER SCIENCE, 1991, 571 : 411 - 428
  • [45] A framework for the specification of test cases for real-time distributed systems
    Walter, T
    Grabowski, J
    INFORMATION AND SOFTWARE TECHNOLOGY, 1999, 41 (11-12) : 781 - 798
  • [46] A Formal Framework for Conformance Testing of Distributed Real-Time Systems
    Krichen, Moez
    PRINCIPLES OF DISTRIBUTED SYSTEMS, 2010, 6490 : 139 - 142
  • [47] Java']Java framework for distributed real-time embedded systems
    Silva, Elias Teodoro, Jr.
    Freitas, Edison Pignaton
    Wagner, Flavio Rech
    Carvalho, Fabiano Costa
    Pereira, Carlos Eduardo
    NINTH IEEE INTERNATIONAL SYMPOSIUM ON OBJECT AND COMPONENT-ORIENTED REAL-TIME DISTRIBUTED COMPUTING, PROCEEDINGS, 2006, : 85 - 92
  • [48] A Software Framework for Hard Real-Time Distributed Embedded Systems
    Angelov, Christo
    Sierszecki, Krzysztof
    Zhou, Feng
    PROCEEDINGS OF THE 34TH EUROMICRO CONFERENCE ON SOFTWARE ENGINEERING AND ADVANCED APPLICATIONS, 2008, : 385 - 392
  • [49] A robust framework for real-time distributed processing of satellite data
    Tehranian, S
    Zhao, YS
    Harvey, T
    Swaroop, A
    Mckenzie, K
    JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2006, 66 (03) : 403 - 418
  • [50] A Distributed Framework for Real-Time Twitter Sentiment Analysis and Visualization
    Murthy, Jamuna S.
    Siddesh, G. M.
    Srinivasa, K. G.
    RECENT FINDINGS IN INTELLIGENT COMPUTING TECHNIQUES, VOL 3, 2018, 709 : 55 - 61