Interoperable Job Execution and Data Access through UNICORE and the Global Federated File System

被引:0
|
作者
Memon, Shahbaz [1 ,3 ]
Riedel, Morris [1 ,3 ]
Koeritz, Chris [2 ]
Grimshaw, Andrew [2 ]
机构
[1] Forschungszentrum Julich, Juelich Supercomp Ctr, Julich, Germany
[2] Univ Virginia, Dept Comp Sci, Charlottesville, VA 22903 USA
[3] Univ Iceland, Sch Engn & Nat Sci, Reykjavik, Iceland
关键词
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Computing middlewares play a vital role for abstracting complexities of backend resources by providing a seamless access to heterogeneous execution management services. Scientific communities are taking advantage of such technologies to focus on science rather than dealing with technical intricacies of accessing resources. Multi-disciplinary communities often bring dynamic requirements which are not trivial to realize. Specifically, to attain massivley parallel data processing on supercomputing resources which require an access to large data sets from widely distributed and dynamic sources located across organizational boundaries. In order to support this abstract scenario, we bring a combination that integrates UNICORE middleware and the Global Federated File System. Furthermore, the paper gives architectural and implementation perspective of UNICORE extension and its interaction with Global Federated File System space through computing, data and security standards.
引用
收藏
页码:269 / 274
页数:6
相关论文
共 50 条
  • [31] DP-GenFL: a local differentially private federated learning system through generative data
    Jun LI
    Kang WEI
    Chuan MA
    Feng SHU
    ScienceChina(InformationSciences), 2023, 66 (08) : 275 - 276
  • [32] DP-GenFL: a local differentially private federated learning system through generative data
    Li, Jun
    Wei, Kang
    Ma, Chuan
    Shu, Feng
    SCIENCE CHINA-INFORMATION SCIENCES, 2023, 66 (08)
  • [33] MorphStore: A Local File System for Big Data with Utility-driven Replication and Load-adaptive Access Scheduling
    Villasenor, Eric
    Pritchett, Timothy
    Dyaberi, Jagadeesh M.
    Pal, Vijay S.
    Thottethodi, Mithuna
    2014 30TH SYMPOSIUM ON MASSIVE STORAGE SYSTEMS AND TECHNOLOGIES (MSST), 2014,
  • [34] New visual access to production through the use of an optimized data acquisition system
    Kalkert, P
    Schönen, T
    ZKG INTERNATIONAL, 2004, 57 (03): : 30 - +
  • [35] Access efficiency of small sized files in Big Data using various Techniques on Hadoop Distributed File System platform
    Alange, Neeta
    Mathur, Anjali
    INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2021, 21 (07): : 359 - 364
  • [36] Breaking Vendors and City Locks through a Semantic-enabled Global Interoperable Internet-of-Things System: A Smart Parking Case
    Sotres, Pablo
    Lanza, Jorge
    Sanchez, Luis
    Ramon Santana, Juan
    Lopez, Carmen
    Munoz, Luis
    SENSORS, 2019, 19 (02):
  • [37] Improvements to a global ocean data assimilation system through the incorporation of Aquarius surface salinity data
    Toyoda, Takahiro
    Fujii, Yosuke
    Kuragano, Tsurane
    Matthews, John P.
    Abe, Hiroto
    Ebuchi, Naoto
    Usui, Norihisa
    Ogawa, Koji
    Kamachi, Masafumi
    QUARTERLY JOURNAL OF THE ROYAL METEOROLOGICAL SOCIETY, 2015, 141 (692) : 2750 - 2759
  • [38] Building hierarchical grid storage using the GFARM global file system and the JUXMEM grid data-sharing service
    Antoniu, Gabriel
    Cudennec, Loie
    Ghareeb, Majd
    Tatebe, Osamu
    EURO-PAR 2008 PARALLEL PROCESSING, PROCEEDINGS, 2008, 5168 : 456 - 465
  • [39] The NASA Astrophysics Data System: Free Access to the Astronomical Literature On-line and through Email
    Guenther Eichhorn
    Alberto Accomazzi
    Carolyn S. Grant
    Michael J. Kurtz
    Stephen S. Murray
    Astrophysics and Space Science, 2002, 282 : 299 - 340
  • [40] MULTI-MEDIA DATABASE ACCESS SERVICES PROVIDED THROUGH A DATA COMMUNICATION PROCESSING SYSTEM
    SAKAMA, Y
    NAKAGAWA, S
    ITO, M
    REVIEW OF THE ELECTRICAL COMMUNICATIONS LABORATORIES, 1984, 32 (06): : 1036 - 1043