Design of Space Remote Sensing Data Storage Platform Based on Distributed File System

被引:0
|
作者
Li, Di [1 ,2 ]
Peng, Yizhun [1 ,2 ]
Bai, Ruixiang [1 ,2 ]
Chen, Zhenjiang [1 ,2 ]
Zhao, Lianchen [1 ,2 ]
机构
[1] Tianjin Univ Sci & Technol, Coll Elect Informat & Automat, Tianjin 300222, Peoples R China
[2] Tianjin Univ Sci & Technol, Adv Struct Integr Int Joint Res Ctr, Tianjin 300222, Peoples R China
关键词
Namenode; Datanode; HDFS; Space remote sensing data; Hadoop;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Due to the large space remote sensing data, a space remote sensing data has seven or eight hundred megabytes or more, and a large amount of space remote sensing data is generated every day for hundreds of GB, TB or even more, so a large amount of space is needed for storage. Space remote sensing data. In order to solve such problems, this paper prepares for the analysis of the subsequent space remote sensing data and combines the distributed file system to store the space remote sensing data. The installation of the CentOS 6.5 virtual machine through VMware to build an HDFS cluster, through a Namenode, three Datanode nodes to achieve access to space remote sensing data. Through the upload of the server, the space remote sensing data can be uploaded to the client, and the space remote sensing data can be downloaded through the client.
引用
收藏
页码:560 / 563
页数:4
相关论文
共 50 条
  • [1] Design and Implementation of Distributed Space Remote Sensing Data Processing System
    Li, Jin
    Sun, Hejie
    39TH YOUTH ACADEMIC ANNUAL CONFERENCE OF CHINESE ASSOCIATION OF AUTOMATION, YAC 2024, 2024, : 1224 - 1227
  • [2] A Distributed File-Based Storage System for Improving High Availability of Space Weather Data
    Andrian, Yoga
    Kim, Hyeonwoo
    Ju, Hongtaek
    APPLIED SCIENCES-BASEL, 2019, 9 (23):
  • [3] Smart Medical Big Data Platform Based on Distributed File System
    Cai, Yonghua
    BASIC & CLINICAL PHARMACOLOGY & TOXICOLOGY, 2020, 127 : 111 - 111
  • [4] Open Source File System Selection for Remote Sensing Data Operational Storage and Processing
    Vinogradov, Andrei N.
    Kurshev, Evgeny P.
    Belov, Sergey
    CYBER-PHYSICAL SYSTEMS AND CONTROL, 2020, 95 : 290 - 304
  • [5] An improved distributed storage and query for remote sensing data
    Jing, Weipeng
    Tian, Dongxue
    2017 INTERNATIONAL CONFERENCE ON IDENTIFICATION, INFORMATION AND KNOWLEDGE IN THE INTERNET OF THINGS, 2018, 129 : 238 - 247
  • [6] Implementation of Remote-Sensing Data Processing Platform Based on Computable Storage
    Qiu, Zeyu
    Liu, Jiahong
    Yang, Xu
    Zha, Renpeng
    Li, Zhen
    Bai, Xishan
    MOBILE INFORMATION SYSTEMS, 2022, 2022
  • [7] Towards Building a Distributed File System for Remote Sensing Image Process
    Li, Zhenju
    Li, Xuejun
    Liu, Tao
    Xie, Jianwei
    PROCEEDINGS OF 2016 IEEE INTERNATIONAL CONFERENCE ON BIG DATA ANALYSIS (ICBDA), 2016, : 311 - 314
  • [8] Research on Storage and Retrieval Strategy of Massive Remote Sensing Data Based on Embedded Database File
    Yang, Jun
    Nie, Kun-Kun
    Gao, Sheng-Hua
    Tang, Xiao-Jing
    FUZZY SYSTEM AND DATA MINING, 2016, 281 : 390 - 396
  • [9] File Repair with Cluster Based Distributed Storage System
    Haytaoglu, Elif
    Dalkilic, Mehmet Emin
    2017 25TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2017,
  • [10] The Design of Distributed File System Based on HDFS
    Wang, Yannan
    Zhang, Shudong
    Liu, Hui
    APPLIED MATERIALS AND TECHNOLOGIES FOR MODERN MANUFACTURING, PTS 1-4, 2013, 423-426 : 2733 - 2736