High Performance Processing of Satellite Data Using Distributed and Parallel Computing Techniques

被引:0
|
作者
Damahe, Lalit B. [1 ]
Bramhe, Sanket S. [1 ]
Fursule, Nilay C. [1 ]
Shirbhate, Ram D. [1 ]
Ajmire, Pournima S. [1 ]
Kumar, Girish [2 ]
机构
[1] Yeshwantrao Chavan Coll Engn, Dept Comp Technol, Nagpur, Maharashtra, India
[2] ISRO, RRSC Cent, Nagpur, Maharashtra, India
来源
关键词
APACHE SPARK; DISTRIBUTIVE COMPUTING; HIGH-PERFORMANCE COMPUTING; PARALLEL COMPUTING; SATELLITE DATA;
D O I
10.21786/bbrc/13.14/92
中图分类号
Q81 [生物工程学(生物技术)]; Q93 [微生物学];
学科分类号
071005 ; 0836 ; 090102 ; 100705 ;
摘要
In today's world of technological revolution when the volume of the data is increasing enormously coincided with the growth in technology, it has become crucial to process and store data adroitly. Due to increasing demand of high processing speed, the traditional methods of processing satellite data have become incompetent. This propelled the need for high performance computing, which is the ability to process data and complex calculations at an accelerated speed effectively and accurately. It takes prolonged time for batch processing of satellite images which acts as the foundation of analysis developments in many technological and geological fields. In this paper, presented, a proposed distributed and parallel computation solutions for satellite image processing and computation of various indices normalized difference vegetation index that improves the performance of the system. By taking advantage of apache spark and cluster computing techniques real-time high-speed stream processing of satellite data is achieved. Some main features are discussed comprehensively about apache spark cluster formation, distributive and parallel computing methodologies, calculation and processing of indices with satellite data of Landsat 5. Also, python programs for processing of satellite data of Landsat 5 are executed and their results are presented in terms of processing speed and time.
引用
收藏
页码:404 / 409
页数:6
相关论文
共 50 条
  • [31] Parallel language processing system for high-performance computing
    Yamanaka, E
    Shindo, T
    FUJITSU SCIENTIFIC & TECHNICAL JOURNAL, 1997, 33 (01): : 39 - 51
  • [32] Parallel language processing system for high-performance computing
    Yamanaka, Eiji
    Shindo, Tatsuya
    Fujitsu Scientific and Technical Journal, 1997, 33 (01): : 39 - 51
  • [33] HIGH-PERFORMANCE INFORMATION PROCESSING IN DISTRIBUTED COMPUTING SYSTEMS
    Skliarov, Valery K
    Rjabov, Artjom
    Skliarova, Iouliia
    Sudnitson, Alexander
    INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2016, 12 (01): : 139 - 160
  • [34] A HIGH-PERFORMANCE SATELLITE DATA MODEM USING REAL-TIME DIGITAL SIGNAL-PROCESSING TECHNIQUES
    ALLAN, RD
    BRAMWELL, JR
    SAUNDERS, DA
    TOMLINSON, M
    JOURNAL OF THE INSTITUTION OF ELECTRONIC AND RADIO ENGINEERS, 1988, 58 (03): : 117 - 124
  • [35] Study on SAR Data Parallel Processing Using Computing Cluster
    Zhao, Yinghui
    Yue, Xijuan
    Han, Chunming
    PROCEEDINGS OF 2014 IEEE WORKSHOP ON ADVANCED RESEARCH AND TECHNOLOGY IN INDUSTRY APPLICATIONS (WARTIA), 2014, : 327 - 330
  • [36] UAV Cooperative Data Processing Using Distributed Computing Platform
    Chmaj, Grzegorz
    Selvaraj, Henry
    PROGRESS IN SYSTEMS ENGINEERING, 2015, 366 : 455 - 461
  • [37] d2o: a distributed data object for parallel high-performance computing in Python
    Steininger T.
    Greiner M.
    Beaujean F.
    Enßlin T.
    Steininger, Theo (theos@mpa-garching.mpg.de), 1600, SpringerOpen (03)
  • [38] Energy-efficient high-performance parallel and distributed computing
    Khan, Samee Ullah
    Bouvry, Pascal
    Engel, Thomas
    JOURNAL OF SUPERCOMPUTING, 2012, 60 (02): : 163 - 164
  • [39] Energy-efficient high-performance parallel and distributed computing
    Samee Ullah Khan
    Pascal Bouvry
    Thomas Engel
    The Journal of Supercomputing, 2012, 60 : 163 - 164
  • [40] Data Processing Algorithm for Parallel Computing
    Barabanov, Igor
    Barabanova, Elizaveta
    Maltseva, Natalia
    Kvyatkovskaya, Irina
    KNOWLEDGE-BASED SOFTWARE ENGINEERING, JCKBSE 2014, 2014, 466 : 61 - 69