The Design of a Community Science Cloud: The Open Science Data Cloud Perspective

被引:11
|
作者
Grossman, Robert L. [1 ]
Greenway, Matthew [1 ]
Heath, Allison P. [1 ]
Powell, Ray [1 ]
Suarez, Rafael D. [1 ]
Wells, Walt [1 ]
White, Kevin [1 ]
Atkinson, Malcolm [2 ]
Klampanos, Iraklis [2 ]
Alvarez, Heidi L. [3 ]
Harvey, Christine [4 ]
Mambretti, Joe J. [5 ]
机构
[1] Univ Chicago, Chicago, IL 60637 USA
[2] Univ Edinburgh, Edinburgh EH8 9YL, Midlothian, Scotland
[3] Florida Int Univ, Miami, FL 33199 USA
[4] Richard Stockton Coll New Jersey, Galloway, NJ USA
[5] Northwestern Univ, Evanston, IL 60208 USA
基金
美国国家科学基金会; 美国国家卫生研究院;
关键词
data intensive computing; cloud computing; science clouds; open data;
D O I
10.1109/SC.Companion.2012.127
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper we describe the design, and implementation of the Open Science Data Cloud, or OSDC. The goal of the OSDC is to provide petabyte-scale data cloud infrastructure and related services for scientists working with large quantities of data. Currently, the OSDC consists of more than 2000 cores and 2 PB of storage distributed across four data centers connected by 10G networks. We discuss some of the lessons learned during the past three years of operation and describe the software stacks used in the OSDC. We also describe some of the research projects in biology, the earth sciences, and social sciences enabled by the OSDC.
引用
收藏
页码:1051 / 1057
页数:7
相关论文
共 50 条
  • [41] Cloud-Based Processing on Data Science for Visualization
    Ashari, Ahmad
    Tjoa, A. Min
    Riasetiawan, Mardhani
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2016, 7 (02) : 449 - 454
  • [42] Joint ALMA Observatory data science exploration on the cloud
    Pavez, Sergio
    Toledo, Ignacio
    Staig, Tomas
    Ovando, Nicolas
    Velez, Gaston
    Ibsen, Jorge
    Sierra, Jorge
    Grangetto, Agustin
    OBSERVATORY OPERATIONS: STRATEGIES, PROCESSES, AND SYSTEMS IX, 2022, 12186
  • [43] Joint ALMA Observatory data science exploration on the cloud
    Pavez, Sergio
    Toledo, Ignacio
    Staig, Tomas
    Ovando, Nicolás
    Vélez, Gastón
    Ibsen, Jorge
    Sierra, Jorge
    Grangetto, Agustin
    Proceedings of SPIE - The International Society for Optical Engineering, 2022, 12186
  • [44] Current Trends in Cloud Computing for Data Science Experiments
    Jami, Syed Imran
    Munir, Siraj
    INTERNATIONAL JOURNAL OF CLOUD APPLICATIONS AND COMPUTING, 2021, 11 (04) : 80 - 99
  • [45] Cloud computing for data-driven science and engineering
    Simmhan, Yogesh
    Ramakrishnan, Lavanya
    Antoniu, Gabriel
    Goble, Carole
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2016, 28 (04): : 947 - 949
  • [46] An analysis of pollution Citizen Science projects from the perspective of Data Science and Open Science
    Roman, Dumitru
    Reeves, Neal
    Gonzalez, Esteban
    Celino, Irene
    Abd El Kader, Shady
    Turk, Philip
    Soylu, Ahmet
    Corcho, Oscar
    Cedazo, Raquel
    Re Calegari, Gloria
    Scandolari, Damiano
    Simperl, Elena
    DATA TECHNOLOGIES AND APPLICATIONS, 2021, 55 (05) : 622 - 642
  • [47] Linking a Community Platform to the Linked Open Data Cloud
    Rajabi, Enayat
    Marenzi, Ivana
    WWW'15 COMPANION: PROCEEDINGS OF THE 24TH INTERNATIONAL CONFERENCE ON WORLD WIDE WEB, 2015, : 701 - 703
  • [48] The Cancer Genomics Cloud enables complex and multi-omic data science in the cloud
    Ray, Manisha
    DiGiovanna, Jack
    Radenkovic, Jelena
    Tosic, Marko
    Mirkovic, Nikola
    Majic, Boris
    Andjus, Vladan
    Davis-Dusenbery, Brandi
    CANCER RESEARCH, 2020, 80 (16)
  • [49] Open Cloud Computing Interface: Open Community Leading Cloud Standards
    Edmonds, Andy
    Metsch, Thijs
    Papaspyrou, Alexander
    Richardson, Alexis
    ERCIM NEWS, 2010, (83): : 23 - 24
  • [50] MOOC EOODS - MASSIVE OPEN ONLINE COURSE FOR EARTH OBSERVATION AND OPEN DATA SCIENCE: A COURSE TO EDUCATE THE NEXT GENERATION OF EO RESEARCHERS IN DATA CUBES, CLOUD PLATFORMS, AND OPEN SCIENCE
    Zellner, Peter James
    Eckardt, Robert
    Meissl, Stephan
    Dolezalova, Tyna
    Eberle, Jonas
    Claus, Michele
    Callegari, Mattia
    Jacob, Alexander
    Anghelea, Anca
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 1200 - 1202