A plugin-based approach to data analysis for the AMS experiment on the ISS

被引:0
|
作者
Formato, Valerio [1 ]
机构
[1] Ist Nazl Fis Nucl, Sez Perugia, Via A Pascoli Snc, I-06123 Perugia, PG, Italy
关键词
D O I
10.1051/epjconf/201921405038
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In many HEP experiments a typical data analysis workflow requires each user to read the experiment data in order to extract meaningful information and produce relevant plots for the considered analysis. Multiple users accessing the same data result in a redundant access to the data itself, which could be factorized effectively improving the CPU efficiency of the analysis jobs and relieving stress from the storage infrastructure. To address this issue we present a modular and lightweight solution where the users code is embedded in different "analysis plugins" which are then collected and loaded at runtime for execution, where the data is read only once and shared between all the different plugins. This solution was developed for one of the data analysis groups within the AMS collaboration but is easily extendable to all kinds of analyses and workloads that need I/O access on AMS data or custom data formats and can even adapted with little effort to another HEP experiment data. This framework could then be easily embedded into a "analysis train" and we will discuss a possible implementation and different ways to optimise CPU efficiency and execution time.
引用
收藏
页数:7
相关论文
共 50 条
  • [21] Exploring a Plugin-Based System for Crowd and Pathogen Simulation in Unity
    Fernandes, Jordan
    Li, Jack
    Li, Keye
    Mirabile, Joseph
    Vesonder, Gregg
    2020 11TH IEEE ANNUAL UBIQUITOUS COMPUTING, ELECTRONICS & MOBILE COMMUNICATION CONFERENCE (UEMCON), 2020, : 387 - 392
  • [22] MapSQ: A Plugin-based MapReduce Framework for SPARQL Queries on GPU
    Song, Jiaming
    Zhang, Xiaowang
    Peng, Peng
    Feng, Zhiyong
    Zou, Lei
    COMPANION PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE 2018 (WWW 2018), 2018, : 81 - 82
  • [23] Recent results of the AMS-02 experiment on the ISS
    Casaus, Jorge
    4TH SYMPOSIUM ON PROSPECTS IN THE PHYSICS OF DISCRETE SYMMETRIES (DISCRETE2014), 2015, 631
  • [24] First Results of the AMS-02 Experiment on the ISS
    Casaus, Jorge
    COSMIC RAY ANISOTROPY WORKSHOP 2013 (CRA2013), 2014, 531
  • [25] Extraction and evolution of architectural variability models in plugin-based systems
    Acher, Mathieu
    Cleve, Anthony
    Collet, Philippe
    Merle, Philippe
    Duchien, Laurence
    Lahire, Philippe
    SOFTWARE AND SYSTEMS MODELING, 2014, 13 (04): : 1367 - 1394
  • [26] Plugin-based interoperability and ecosystem management for the MolSSI Driver Interface Project
    Barnes, T. A.
    Ellis, S.
    Chen, J.
    Plimpton, S. J.
    Nash, J. A.
    JOURNAL OF CHEMICAL PHYSICS, 2024, 160 (21):
  • [27] Using a lightweight workflow engine in a plugin-based product line architecture
    Cervantes, Humberto
    Charleston-Villalobos, Sonia
    COMPONENT-BASED SOFTWARE ENGINEERING, PROCEEDINGS, 2006, 4063 : 198 - 205
  • [28] METCO: A PARALLEL PLUGIN-BASED FRAMEWORK FOR MULTI-OBJECTIVE OPTIMIZATION
    Leon, Coromoto
    Miranda, Gara
    Segura, Carlos
    INTERNATIONAL JOURNAL ON ARTIFICIAL INTELLIGENCE TOOLS, 2009, 18 (04) : 569 - 588
  • [29] Understanding Vulnerabilities in Plugin-based Web Systems: An Exploratory Study of WordPress
    Mesa, Oslien
    Vieira, Reginaldo
    Viana, Marx
    Durelli, Vinicius H. S.
    Cirilo, Elder
    Kalinowski, Marcos
    Lucena, Carlos
    SPLC'18: PROCEEDINGS OF THE 22ND INTERNATIONAL SYSTEMS AND SOFTWARE PRODUCT LINE CONFERENCE, VOL 1, 2018, : 149 - 159
  • [30] An extensible, plugin-based tool for modeling flow and reactive transport in water systems
    Massoudieh, Arash
    Nguyen, Khiem
    Murthy, Sudhir
    ENVIRONMENTAL MODELLING & SOFTWARE, 2023, 164