A Distributed Data Management System for Data-intensive Radio Astronomy

被引：0

作者：

Grimstrup, Arne ^{[1
]}

Mahadevan, Venkat ^{[2
]}

Eymere, Olivier

Anderson, Ken ^{[2
]}

Kiddle, Cameron ^{[1
]}

Simmonds, Rob ^{[1
]}

Rosolowsky, Erik ^{[2
]}

Taylor, Andrew R. ^{[1
]}

机构：

[1] Univ Calgary, Calgary, AB, Canada

[2] Univ British Columbia, Kelowna, BC, Canada

来源：

SOFTWARE AND CYBERINFRASTRUCTURE FOR ASTRONOMY II | 2012年 / 8451卷

关键词：

SKA; archive; distributed; architecture; VISUALIZATION;

D O I：

10.1117/12.925441

中图分类号：

P1 [天文学];

学科分类号：

0704 ;

摘要：

The next generation of telescopes, such as the Square Kilometre Array (SKA), will generate orders of magnitude more data than previous instruments, far in excess of current storage and networking system handling abilities. To address this problem, we propose an architecture where data is distributed over several archive sites, each holding only a portion of the overall data, that provides efficient and transparent access to the archive as a whole. This paper describes that architecture in detail and the design and implementation of a prototype system,based on the Integrated Rule-Oriented Data System (iRODS) software.

引用

页数：8

共 50 条

[21] NSM: A distributed storage architecture for data-intensive applications
Ali, Z
Malluhi, Q
20TH IEEE/11TH NASA GODDARD CONFERENCE ON MASS STORAGE AND TECHNOLOGIES (MSST 2003), PROCEEDINGS, 2003, : 87 - 91
[22] MapReduce Across Distributed Clusters for Data-intensive Applications
Wang, Lizhe
Tao, Jie
Marten, Holger
Streit, Achim
Khan, Samee U.
Kolodziej, Joanna
Chen, Dan
2012 IEEE 26TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS & PHD FORUM (IPDPSW), 2012, : 2004 - 2011
[23] Open active services for data-intensive distributed applications
Collet, C
Vargas-Solar, G
Grazziotin-Ribeiro, H
2000 INTERNATIONAL DATABASE ENGINEERING AND APPLICATIONS SYMPOSIUM - PROCEEDINGS, 2000, : 349 - 359
[24] Supporting Load Balancing For Distributed Data-Intensive Applications
Glimcher, Leonid
Ravi, Vignesh T.
Agrawal, Gagan
16TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING (HIPC), PROCEEDINGS, 2009, : 235 - 244
[25] Open active services for data-intensive distributed applications
Collet, Christine
Vargas-Solar, Genoveva
Grazziotin-Ribeiro, Helena
Proceedings of the International Database Engineering and Applications Symposium, IDEAS, 2000, : 349 - 359
[26] Abstract cost models for distributed data-intensive computations
Li, Rundong
Mi, Ningfang
Riedewald, Mirek
Sun, Yizhou
Yao, Yi
DISTRIBUTED AND PARALLEL DATABASES, 2019, 37 (03) : 411 - 439
[27] Globus toolkit support for distributed data-intensive science
Allcock, W
Chervenak, A
Foster, I
Pearlman, L
Welch, V
Wilde, M
PROCEEDINGS OF CHEP 2001, 2001, : 692 - 695
[28] Abstract cost models for distributed data-intensive computations
Rundong Li
Ningfang Mi
Mirek Riedewald
Yizhou Sun
Yi Yao
Distributed and Parallel Databases, 2019, 37 : 411 - 439
[29] Nebula: Distributed Edge Cloud for Data-Intensive Computing
Ryden, Mathew
Oh, Kwangsung
Chandra, Abhishek
Weissman, Jon
PROCEEDINGS OF THE 2014 INTERNATIONAL CONFERENCE ON COLLABORATION TECHNOLOGIES AND SYSTEMS (CTS), 2014, : 491 - 492
[30] A distributed shared buffer space for data-intensive applications
Lachaize, R
Hansen, JS
2005 IEEE International Symposium on Cluster Computing and the Grid, Vols 1 and 2, 2005, : 913 - 920

← 1 2 3 4 5 →