The Data Ocean Project An ATLAS and Google R&D collaboration

被引:2
|
作者
Barisits, Martin [1 ]
Barreiro, Fernando [2 ]
Beermann, Thomas [3 ]
Bhatia, Karan [4 ]
De, Kaushik [2 ]
Dubreuil, Arnaud [5 ]
Elmsheuser, Johannes [6 ]
Klimentov, Alexei [6 ]
Lassnig, Mario [1 ]
Love, Peter [7 ]
Maeno, Tadashi [6 ]
Manzi, Andrea [1 ]
Mashinistov, Ruslan [6 ]
Murphy, Andy [4 ]
Nilsson, Paul [6 ]
Panitkin, Sergey [6 ]
Wegner, Tobias [1 ]
机构
[1] CERN, European Org Nucl Res, Geneva, Switzerland
[2] Univ Texas Arlington, Arlington, TX 76019 USA
[3] Univ Innsbruck, Innsbruck, Austria
[4] Google LLC, Mountain View, CA USA
[5] Univ Geneva, Geneva, Switzerland
[6] Brookhaven Natl Lab, Upton, NY 11973 USA
[7] Univ Lancaster, Lancaster, England
关键词
D O I
10.1051/epjconf/201921404020
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Transparent use of commercial cloud resources for scientific experiments is a hard problem. In this article, we describe the first steps of the Data Ocean R&D collaboration between the high-energy physics experiment ATLAS together with Google Cloud Platform, to allow seamless use of Google Compute Engine and Google Cloud Storage for physics analysis. We start by describing the three preliminary use cases that were identified at the beginning of the project. The following sections then detail the work done in the data management system Rucio and the workflow management systems PanDA and Harvester to interface Google Cloud Platform with the ATLAS distributed computing environment, and show the results of the integration tests. Afterwards, we describe the setup and results from a full ATLAS user analysis that was executed natively on Google Cloud Platform, and give estimates on projected costs. We close with a summary and and outlook on future work.
引用
收藏
页数:8
相关论文
共 50 条
  • [21] Global R&D Collaboration in the Development of Nanotechnology: The Impact of R&D Collaboration Patterns on Patent Quality
    Lo, Chih-cheng
    Cho, Hsin-Chuan
    Wang, Pin-Wei
    SUSTAINABILITY, 2020, 12 (15)
  • [22] EUPRO - A reference database on project-based R&D collaboration networks
    Scherngell, Thomas
    Barber, Michael
    Zahradnik, Georg
    Wolfmayr, Anna
    Shkodra, Xheneta Bilalli
    SCIENTIFIC DATA, 2024, 11 (01)
  • [23] EUPRO - A reference database on project-based R&D collaboration networks
    Thomas Scherngell
    Michael Barber
    Georg Zahradnik
    Anna Wolfmayr
    Xheneta Bilalli Shkodra
    Scientific Data, 11
  • [24] Google to establish R&D center in Japan
    不详
    R&D MAGAZINE, 2004, 46 (06): : 21 - 21
  • [25] Formal R&D Management and Research Collaboration and R&D Outsourcing in SMEs
    Teirlinck, Peter
    Spithoven, Andre
    PROCEEDINGS OF THE 6TH EUROPEAN CONFERENCE ON INNOVATION AND ENTREPRENEURSHIP, VOL 1 AND 2, 2011, : 820 - 826
  • [26] Stopping an R&D project
    Kumar, Vinod
    Persaud, Aditha N.S.
    Kumar, Uma
    IEEE Potentials, 1997, 16 (2 Suppl): : 13 - 16
  • [27] R&D COLLABORATION FOR ENVIRONMENTAL INNOVATION
    Pippel, Gunnar
    INTERNATIONAL JOURNAL OF INNOVATION MANAGEMENT, 2015, 19 (01)
  • [28] Web based R&D collaboration
    Jovanovic, Jelena
    Tomasevic, Violeta
    Dudukovic, Jovan
    PROCEEDINGS OF THE 7TH WSEAS INTERNATIONAL CONFERENCE ON APPLIED INFORMATICS AND COMMUNICATIONS, 2007, : 388 - 391
  • [29] Strategic upstream R&D collaboration
    Dingle, HB
    JOURNAL OF CANADIAN PETROLEUM TECHNOLOGY, 2002, 41 (09): : 19 - 22
  • [30] Managing the appropriability of R&D collaboration
    Henttonen, Kaisa
    Hurmelinna-Laukkanen, Pia
    Ritala, Paavo
    R & D MANAGEMENT, 2016, 46 : 145 - 158