Distributed caching strategy for hot news propagation based on data engineering processing

被引：0
|
作者：
Duan, Lanlan [1 ]
机构：
[1] Henan Light Ind Vocat Coll, Zhengzhou, Peoples R China
来源：
INTERNET TECHNOLOGY LETTERS | 2025年 / 8卷 / 01期
关键词：
data engineering; distributed cache; hot news collection; news propagation; searching engine; PUBLIC-OPINION;
D O I：
10.1002/itl2.426
中图分类号：
TN [电子技术、通信技术];
学科分类号：
0809 ;
摘要：
In order to improve the performance of the hot news collection and propagation of hotspot news, we aim at improving the performance and solve the opinion collection and propagation bottleneck by analyzing the demand and framework of current hot news supported systems. Then, a corresponding opinion collection and propagation optimization framework and strategy are proposed with a distributed hotspot caching system is designed and implemented. On the basis of the existing distributed search engine, a cache server is added between the overall hotspot query processing server and each cluster sub-query processing server, so that we can improve the caching and searching efficiency greatly. The experimental results show that after using the proposed distributed caching system and strategy for hot news propagation, the processing capacity of the hot news system has been greatly enhanced.
引用
收藏
页数：6
相关论文
共 50 条
  • [1] Replication Strategy for Spatiotemporal Data Based on Distributed Caching System
    Xiong, Lian
    Yang, Liu
    Tao, Yang
    Xu, Juan
    Zhao, Lun
    SENSORS, 2018, 18 (01):
  • [2] Identification of Hot data and Caching strategy for Industrial Big Data Based on Temperature Model
    Wang, Yao
    Zhao, Jiong
    Zhou, Qicai
    Xiong, Xiaolei
    Zhang, Heng
    Chen, Chuanlin
    2023 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING, BIGCOMP, 2023, : 289 - 290
  • [3] In-Memory Indexed Caching for Distributed Data Processing
    Uta, Alexandru
    Ghit, Bogdan
    Dave, Ankur
    Rellermeyer, Jan
    Boncz, Peter
    2022 IEEE 36TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM (IPDPS 2022), 2022, : 104 - 114
  • [4] Data Locality via Coordinated Caching for Distributed Processing
    Fischer, M.
    Kuehn, E.
    Giffels, M.
    Jung, C.
    17TH INTERNATIONAL WORKSHOP ON ADVANCED COMPUTING AND ANALYSIS TECHNIQUES IN PHYSICS RESEARCH (ACAT2016), 2016, 762
  • [5] Acorn: Aggressive Result Caching in Distributed Data Processing Frameworks
    Ramjit, Lana
    Interlandi, Matteo
    Wu, Eugene
    Netravali, Ravi
    PROCEEDINGS OF THE 2019 TENTH ACM SYMPOSIUM ON CLOUD COMPUTING (SOCC '19), 2019, : 206 - 219
  • [6] AutoReplica: Automatic Data Replica Manager in Distributed Caching and Data Processing Systems
    Yang, Zhengyu
    Wang, Jiayin
    Evans, David
    Mi, Ningfang
    2016 IEEE 35TH INTERNATIONAL PERFORMANCE COMPUTING AND COMMUNICATIONS CONFERENCE (IPCCC), 2016,
  • [7] Distributed Probabilistic Caching Strategy in VANETs through Named Data Networking
    Deng, Gang
    Wang, Liwei
    Li, Fengchao
    Li, Rere
    2016 IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS (INFOCOM WKSHPS), 2016,
  • [8] DP STRATEGY - DISTRIBUTED DATA-PROCESSING
    MANDELL, M
    COMPUTER DECISIONS, 1978, 10 (07): : 24 - &
  • [9] An enhanced active caching strategy for data-intensive computations in distributed GIS
    Pan, Shaoming
    Chong, Yanwen
    Xu, Zhengquan
    Tan, Xicheng
    JOURNAL OF SUPERCOMPUTING, 2017, 73 (10): : 4324 - 4346
  • [10] An enhanced active caching strategy for data-intensive computations in distributed GIS
    Shaoming Pan
    Yanwen Chong
    Zhengquan Xu
    Xicheng Tan
    The Journal of Supercomputing, 2017, 73 : 4324 - 4346
12345