Development of distributed file system for storing weather data

被引:7
|
作者
Sherstnev, V. S. [1 ]
Botygin, I. A. [1 ]
Zenzin, A. S. [1 ]
Sherstneva, A. I. [1 ]
Galanova, N. Y. [2 ]
机构
[1] Natl Res Tomsk State Univ, Lenin Ave 40, Tomsk 634050, Russia
[2] Natl Res Tomsk Polytech Univ, Lenin Ave 36, Tomsk 634050, Russia
关键词
distributed systems; distributed file system; network storage; meta-description; cross-platform; big data;
D O I
10.1117/12.2249248
中图分类号
P4 [大气科学(气象学)];
学科分类号
0706 ; 070601 ;
摘要
This article presents the results of developing a software for surface meteorological observation network storage. Multithreading was used to simulate a distributed cluster of information-computational resources during the software testing. This technology is used to create concurrently executing threads and is supported by practically every operating system. The architecture of the meteorological data network storage was designed and includes the following modules: coordinating module (monitors and displays computing nodes), database manager module (distributes meteorological data and executes user queries), client module (allows accessing the data), terminal modules (allows uploading new data), storage and processing modules (nodes for distributed data storage). The system was designed using platform-independent development tools (Java technologies), underwent simulation testing to improve the module interaction, ensure system performance, stability and reliability during processing large volumes of meteorological data.
引用
收藏
页数:6
相关论文
共 50 条
  • [21] THE PULSE DISTRIBUTED FILE SYSTEM
    TOMLINSON, GM
    KEEFFE, D
    WAND, IC
    WELLINGS, AJ
    SOFTWARE-PRACTICE & EXPERIENCE, 1985, 15 (11): : 1087 - 1101
  • [22] Distributed hypercube file system
    Flynn, R.J.
    Hadimioglu, H.
    Conference on Hypercube Concurrent Computers and Applications, 1988,
  • [23] A DISTRIBUTED FILE SYSTEM FOR MINIX
    GAMMILL, R
    HERNES, J
    SCCS PROCEEDINGS : 22ND ANNUAL SMALL COLLEGE COMPUTING SYMPOSIUM, 1989, : 151 - 160
  • [24] The Hadoop Distributed File System
    Shvachko, Konstantin
    Kuang, Hairong
    Radia, Sanjay
    Chansler, Robert
    2010 IEEE 26TH SYMPOSIUM ON MASS STORAGE SYSTEMS AND TECHNOLOGIES (MSST), 2010,
  • [25] DISTRIBUTED MULTIMEDIA FILE SYSTEM
    Radovici, Alexandru
    Miu, Tudor
    Dragoi, George
    ANNALS OF DAAAM FOR 2009 & PROCEEDINGS OF THE 20TH INTERNATIONAL DAAAM SYMPOSIUM, 2009, 20 : 593 - 594
  • [26] ALDM: Algorithm of Adaptive Loading Data Migration in Distributed File System
    Tan Zhipeng
    Zhou Wei
    Zhang Wenhua
    Feng Dan
    2012 DIGEST ASIA-PACIFIC MAGNETIC RECORDING CONFERENCE (APMRC), 2012,
  • [27] Computer Performance Determination System Based on Big Data Distributed File
    Lu, Kong
    CYBER SECURITY INTELLIGENCE AND ANALYTICS, 2020, 928 : 877 - 884
  • [28] Analysis of DNA Data Using Hadoop Distributed File System.
    Senthilkumar, M.
    Ilango, P.
    RESEARCH JOURNAL OF PHARMACEUTICAL BIOLOGICAL AND CHEMICAL SCIENCES, 2016, 7 (03): : 796 - 803
  • [29] Key technology in distributed file system towards big data analysis
    Zhou, J. (zhoujiang@ncic.ac.cn), 1600, Science Press (51):
  • [30] GDedup: Distributed File System Level Deduplication for Genomic Big Data
    Bartus, Paul
    Arzuaga, Emmanuel
    2018 IEEE INTERNATIONAL CONGRESS ON BIG DATA (IEEE BIGDATA CONGRESS), 2018, : 120 - 127