Applying workflows to scientific projects represented in file system directory tree

被引:2
|
作者
Makuch, Mieszko [1 ]
Malawski, Maciej [1 ]
Kocot, Joanna [2 ]
Szepieniec, Tomasz [2 ]
机构
[1] AGH Univ Sci & Technol, Dept Comp Sci, Krakow, Poland
[2] AGH Univ Sci & Technol, ACC Cyfronet AGH, Krakow, Poland
关键词
Scientific Workflow; Tree structure; Complexity management; Modularity; Reuse; Science Gateways; SCIENCE; TAVERNA;
D O I
10.1109/WORKS51914.2020.00009
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Most workflow management systems represent scientific workflows as DAG (directed acyclic graph) and require to provide a workflow specification before the workflow can be executed. Workflow can be designed using a graphical interface or with textual workflow editing. For uses unacquainted with workflow abstraction, these systems can be complicated as it usually takes multiple steps to design abstract workflow specification. To reduce the learning curve and barriers to entry for inexperienced users, we have decided to create a workflow representation that is based on the well-known file system directory structure. In our representation, the workflow structure can be drawn from project organization space which is based on the file system directory tree. As a result, the proposed workflow representation is more natural and more intuitive for users who are already accustomed to the directory structure. The workflow structure is created on the fly as the user adds, executes and organizes services inside their workspace. We have used tree structure hierarchy to model a part-whole hierarchy between workflows, sub-workflows and individual services. Proposed solutions support modularity with multi-level sub-workflow nesting, encapsulation, workflow reuse and sharing, as well as automated workflow execution in a distributed infrastructure. The proposed model was implemented and evaluated on the IS-EPOS Platform [1], a real-world online workflow management system used to conduct research in the field of anthropogenic seismicity.
引用
收藏
页码:25 / 32
页数:8
相关论文
共 50 条
  • [21] Accelerating Scientific Workflows with Tiered Data Management System
    Cheng, Peng
    Lu, Yutong
    Du, Yunfei
    Chen, Zhiguang
    IEEE 20TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS / IEEE 16TH INTERNATIONAL CONFERENCE ON SMART CITY / IEEE 4TH INTERNATIONAL CONFERENCE ON DATA SCIENCE AND SYSTEMS (HPCC/SMARTCITY/DSS), 2018, : 75 - 82
  • [22] pISA-tree - a data management framework for life science research projects using a standardised directory tree
    Marko Petek
    Maja Zagorščak
    Andrej Blejec
    Živa Ramšak
    Anna Coll
    Špela Baebler
    Kristina Gruden
    Scientific Data, 9
  • [23] pISA-tree - a data management framework for life science research projects using a standardised directory tree
    Petek, Marko
    Zagorscak, Maja
    Blejec, Andrej
    Ramsak, Ziva
    Coll, Anna
    Baebler, Spela
    Gruden, Kristina
    SCIENTIFIC DATA, 2022, 9 (01)
  • [24] How to Get More Value From Your File System Directory Cache
    Tsai, Chia-Che
    Zhan, Yang
    Reddy, Jayashree
    Jiao, Yizheng
    Zhang, Tao
    Porter, Donald
    SOSP'15: PROCEEDINGS OF THE TWENTY-FIFTH ACM SYMPOSIUM ON OPERATING SYSTEMS PRINCIPLES, 2015, : 441 - 456
  • [25] 360° Semantic File System: Augmented Directory Navigation for Nonhierarchical Retrieval of Files
    Mashwani, Syed Rahman
    Khusro, Shah
    IEEE ACCESS, 2019, 7 : 9406 - 9418
  • [26] PROJECTS SOLAR IVY AND SOLAR TREE Interesting ideas applying sunlight
    Oreskovic, Lidija
    GRADEVINAR, 2016, 68 (12): : 1032 - 1034
  • [27] Steganographic schemes for file system and B-tree
    Pang, HH
    Tan, KL
    Zhou, XA
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2004, 16 (06) : 701 - 713
  • [28] MTFS: Merkle-Tree-Based File System
    Kan, Jia
    Kim, Kyeong Soo
    2019 IEEE INTERNATIONAL CONFERENCE ON BLOCKCHAIN AND CRYPTOCURRENCY (ICBC), 2019, : 43 - 47
  • [29] Applying Pwrake Workflow System and Gfarm File System to Telescope Data Processing
    Tanaka, Masahiro
    Tatebe, Osamu
    Kawashima, Hideyuki
    2018 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING (CLUSTER), 2018, : 124 - 133
  • [30] Securing File System Integrity and Version History Via Directory Merkle Trees and Blockchains
    Lackner, Andreas
    Mirhosseini, Seyed Amid Moeinzadeh
    Crass, Stefan
    DATABASE AND EXPERT SYSTEMS APPLICATIONS, DEXA 2022 WORKSHOPS, 2022, 1633 : 294 - 304