A plugin-based approach to data analysis for the AMS experiment on the ISS

被引:0
|
作者
Formato, Valerio [1 ]
机构
[1] Ist Nazl Fis Nucl, Sez Perugia, Via A Pascoli Snc, I-06123 Perugia, PG, Italy
关键词
D O I
10.1051/epjconf/201921405038
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In many HEP experiments a typical data analysis workflow requires each user to read the experiment data in order to extract meaningful information and produce relevant plots for the considered analysis. Multiple users accessing the same data result in a redundant access to the data itself, which could be factorized effectively improving the CPU efficiency of the analysis jobs and relieving stress from the storage infrastructure. To address this issue we present a modular and lightweight solution where the users code is embedded in different "analysis plugins" which are then collected and loaded at runtime for execution, where the data is read only once and shared between all the different plugins. This solution was developed for one of the data analysis groups within the AMS collaboration but is easily extendable to all kinds of analyses and workloads that need I/O access on AMS data or custom data formats and can even adapted with little effort to another HEP experiment data. This framework could then be easily embedded into a "analysis train" and we will discuss a possible implementation and different ways to optimise CPU efficiency and execution time.
引用
收藏
页数:7
相关论文
共 50 条
  • [31] A plugin-based privacy scheme for World-Wide Web file distribution
    Jenkin, M
    Dymond, P
    PROCEEDINGS OF THE THIRTY-FIRST HAWAII INTERNATIONAL CONFERENCE ON SYSTEM SCIENCES, VOL VII: SOFTWARE TECHNOLOGY TRACK, 1998, : 621 - 627
  • [32] CEDLES: a framework for plugin-based applications for earthquake risk prediction and loss assessment
    Li Long
    Shansuo Zheng
    Yixin Zhang
    Longfei Sun
    Yan Zhou
    Liguo Dong
    Natural Hazards, 2020, 103 : 531 - 556
  • [33] CEDLES: a framework for plugin-based applications for earthquake risk prediction and loss assessment
    Long, Li
    Zheng, Shansuo
    Zhang, Yixin
    Sun, Longfei
    Zhou, Yan
    Dong, Liguo
    NATURAL HAZARDS, 2020, 103 (01) : 531 - 556
  • [34] Open Ephys: an open-source, plugin-based platform for multichannel electrophysiology
    Siegle, Joshua H.
    Lopez, Aaron Cuevas
    Patel, Yogi A.
    Abramov, Kirill
    Ohayon, Shay
    Voigts, Jakob
    JOURNAL OF NEURAL ENGINEERING, 2017, 14 (04)
  • [35] Exploring Variability-Aware Execution for Testing Plugin-Based Web Applications
    Hung Viet Nguyen
    Kastner, Christian
    Nguyen, Tien N.
    36TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING (ICSE 2014), 2014, : 907 - 918
  • [36] Development of a plugin-based prototype for spatial explicit application of fuzzy multicriteria evaluation
    Sanz-Blasco, Eduardo
    Gomez-Delgado, Montserrat
    Clemente-Parraga, Julia
    Aguilera-Benavente, Francisco
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 276
  • [37] MINERVA: A multi-modality plugin-based radiation therapy treatment planning system
    Wemple, CA
    Wessol, DE
    Nigg, DW
    Cogliati, JJ
    Milvich, M
    Fredrickson, CM
    Perkins, M
    Harkin, GJ
    Hartmann-Siantar, CL
    Lehmann, J
    Flickinger, T
    Pletcher, D
    Yuan, A
    DeNardo, GL
    RADIATION PROTECTION DOSIMETRY, 2005, 116 (1-4) : 202 - 207
  • [38] Kali-ma: A Semantic Guide to Browsing and Accessing Functionalities in Plugin-Based Tools
    Adamou, Alessandro
    Presutti, Valentina
    Gangemi, Aldo
    KNOWLEDGE ENGINEERING AND MANAGEMENT BY THE MASSES, EKAW 2010, 2010, 6317 : 483 - 492
  • [39] A New GCC Plugin-Based Compiler Pass to Add Support for Thread-Level Speculation into OpenMP
    Aldea, Sergio
    Estebanez, Alvaro
    Llanos, Diego R.
    Gonzalez-Escribano, Arturo
    EURO-PAR 2014 PARALLEL PROCESSING, 2014, 8632 : 234 - 245
  • [40] Alpha Magnetic Spectrometer (AMS02) experiment on the International Space Station (ISS)
    Behcet ALPAT
    Nuclear Science and Techniques, 2003, (03) : 182 - 194