High Performance Processing of Satellite Data Using Distributed and Parallel Computing Techniques

被引:0
|
作者
Damahe, Lalit B. [1 ]
Bramhe, Sanket S. [1 ]
Fursule, Nilay C. [1 ]
Shirbhate, Ram D. [1 ]
Ajmire, Pournima S. [1 ]
Kumar, Girish [2 ]
机构
[1] Yeshwantrao Chavan Coll Engn, Dept Comp Technol, Nagpur, Maharashtra, India
[2] ISRO, RRSC Cent, Nagpur, Maharashtra, India
来源
关键词
APACHE SPARK; DISTRIBUTIVE COMPUTING; HIGH-PERFORMANCE COMPUTING; PARALLEL COMPUTING; SATELLITE DATA;
D O I
10.21786/bbrc/13.14/92
中图分类号
Q81 [生物工程学(生物技术)]; Q93 [微生物学];
学科分类号
071005 ; 0836 ; 090102 ; 100705 ;
摘要
In today's world of technological revolution when the volume of the data is increasing enormously coincided with the growth in technology, it has become crucial to process and store data adroitly. Due to increasing demand of high processing speed, the traditional methods of processing satellite data have become incompetent. This propelled the need for high performance computing, which is the ability to process data and complex calculations at an accelerated speed effectively and accurately. It takes prolonged time for batch processing of satellite images which acts as the foundation of analysis developments in many technological and geological fields. In this paper, presented, a proposed distributed and parallel computation solutions for satellite image processing and computation of various indices normalized difference vegetation index that improves the performance of the system. By taking advantage of apache spark and cluster computing techniques real-time high-speed stream processing of satellite data is achieved. Some main features are discussed comprehensively about apache spark cluster formation, distributive and parallel computing methodologies, calculation and processing of indices with satellite data of Landsat 5. Also, python programs for processing of satellite data of Landsat 5 are executed and their results are presented in terms of processing speed and time.
引用
收藏
页码:404 / 409
页数:6
相关论文
共 50 条
  • [41] Satellite Image Processing on Parallel Computing: a Technical Review
    Buche, Snehal B.
    Dhondse, Shweta A.
    Khobragade, Anand N.
    PROCEEDINGS OF 2016 ONLINE INTERNATIONAL CONFERENCE ON GREEN ENGINEERING AND TECHNOLOGIES (IC-GET), 2016,
  • [42] Cloud Computing for Satellite Data Processing on High End Compute Clusters
    Golpayegani, N.
    Halem, M.
    CLOUD: 2009 IEEE INTERNATIONAL CONFERENCE ON CLOUD COMPUTING, 2009, : 88 - 92
  • [43] High-Performance Computing for Big Data Processing
    Wu, Yulei
    Xiang, Yang
    Ge, Jingguo
    Muller, Peter
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2018, 88 : 693 - 695
  • [44] Parallel and Distributed Powerset Generation Using Big Data Processing
    Essa, Youssef M.
    El-Mahalawy, Ahmed
    Attiya, Gamal
    El-Sayed, Ayman
    APPLIED ARTIFICIAL INTELLIGENCE, 2019, 33 (13) : 1133 - 1156
  • [45] A performance and portability study of parallel applications using a distributed computing testbed
    Morariu, V
    Cunningham, M
    Letterman, M
    SIXTH HETEROGENEOUS COMPUTING WORKSHOP (HCW '97), PROCEEDINGS, 1997, : 222 - 231
  • [46] Lightweight distributed computing framework for orchestrating high performance computing and big data
    Ince, Muhammed Numan
    Gunay, Melih
    Ledet, Joseph
    TURKISH JOURNAL OF ELECTRICAL ENGINEERING AND COMPUTER SCIENCES, 2022, 30 (04) : 1571 - 1585
  • [47] Distributed High Performance Computing using JAVA']JAVA
    Shakya, Subarna
    Chaulagain, Ram Sharan
    Pandey, Santosh
    Gyawali, Prakash
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION AND AUTOMATION (ICCCA), 2017, : 742 - 747
  • [48] High Productivity Processing - Engaging in Big Data around Distributed Computing
    Riedel, Morris
    Memon, M.
    Memon, A.
    Fiameni, G.
    Cacciari, C.
    Lippert, Thomas
    2013 36TH INTERNATIONAL CONVENTION ON INFORMATION AND COMMUNICATION TECHNOLOGY, ELECTRONICS AND MICROELECTRONICS (MIPRO), 2013, : 145 - 150
  • [49] Distributed Parallel Computing in Data Analysis of Osteoporosis
    Simoes, Priscyla Waleska
    Venson, Ramon
    Comunello, Eros
    Casagrande, Rogerio Antonio
    Bigaton, Everson
    Carlessi, Lucas da Silva
    da Rosa, Maria Ines
    Martins, Paulo Joao
    MEDINFO 2015: EHEALTH-ENABLED HEALTH, 2015, 216 : 1082 - 1082
  • [50] Parallel and distributed computing for Big Data applications
    Senger, Hermes
    Geyer, Claudio
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2016, 28 (08): : 2412 - 2415