Applying workflows to scientific projects represented in file system directory tree

被引:2
|
作者
Makuch, Mieszko [1 ]
Malawski, Maciej [1 ]
Kocot, Joanna [2 ]
Szepieniec, Tomasz [2 ]
机构
[1] AGH Univ Sci & Technol, Dept Comp Sci, Krakow, Poland
[2] AGH Univ Sci & Technol, ACC Cyfronet AGH, Krakow, Poland
关键词
Scientific Workflow; Tree structure; Complexity management; Modularity; Reuse; Science Gateways; SCIENCE; TAVERNA;
D O I
10.1109/WORKS51914.2020.00009
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Most workflow management systems represent scientific workflows as DAG (directed acyclic graph) and require to provide a workflow specification before the workflow can be executed. Workflow can be designed using a graphical interface or with textual workflow editing. For uses unacquainted with workflow abstraction, these systems can be complicated as it usually takes multiple steps to design abstract workflow specification. To reduce the learning curve and barriers to entry for inexperienced users, we have decided to create a workflow representation that is based on the well-known file system directory structure. In our representation, the workflow structure can be drawn from project organization space which is based on the file system directory tree. As a result, the proposed workflow representation is more natural and more intuitive for users who are already accustomed to the directory structure. The workflow structure is created on the fly as the user adds, executes and organizes services inside their workspace. We have used tree structure hierarchy to model a part-whole hierarchy between workflows, sub-workflows and individual services. Proposed solutions support modularity with multi-level sub-workflow nesting, encapsulation, workflow reuse and sharing, as well as automated workflow execution in a distributed infrastructure. The proposed model was implemented and evaluated on the IS-EPOS Platform [1], a real-world online workflow management system used to conduct research in the field of anthropogenic seismicity.
引用
收藏
页码:25 / 32
页数:8
相关论文
共 50 条
  • [1] Model and system for scientific workflows represented in file system directory tree
    Makuch, Mieszko
    Malawski, Maciej
    Kocot, Joanna
    Szepieniec, Tomasz
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2022, 133 : 378 - 394
  • [2] A PORTABLE FILE DIRECTORY SYSTEM
    HANSON, DR
    SOFTWARE-PRACTICE & EXPERIENCE, 1980, 10 (08): : 623 - 634
  • [3] Adaptive File Management for Scientific Workflows on the Azure Cloud
    Tudoran, Radu
    Costan, Alexandru
    Rad, Ramin Rezai
    Brasche, Goetz
    Antoniu, Gabriel
    2013 IEEE INTERNATIONAL CONFERENCE ON BIG DATA, 2013,
  • [4] Balancing push and pull in Confuga, an active storage cluster file system for scientific workflows
    Donnelly, Patrick
    Thain, Douglas
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2017, 29 (04):
  • [5] Analysing scientific workflows with Computational Tree Logic
    Vasa Curcin
    Moustafa M. Ghanem
    Yike Guo
    Cluster Computing, 2009, 12 : 399 - 419
  • [6] Analysing scientific workflows with Computational Tree Logic
    Curcin, Vasa
    Ghanem, Moustafa M.
    Guo, Yike
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2009, 12 (04): : 399 - 419
  • [7] Distributed directory service in the farsite file system
    Douceur, John R.
    Howell, Jon
    USENIX ASSOCIATION 7TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, 2006, : 321 - +
  • [8] Distributed and Scalable Directory Service in a Parallel File System
    Wang, Lixin
    Lu, Yutong
    Zhang, Wei
    Lei, Yan
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2016, E99D (02): : 313 - 323
  • [9] AN 8080 FIG-FORTH DIRECTORY AND FILE SYSTEM
    MONROE, AJ
    DR DOBBS JOURNAL, 1983, 8 (04): : 38 - &
  • [10] Hashing directory scheme for NAND flash file system
    Lim, Seung-Ho
    Lee, Chul
    Park, Kyu-Ho
    9TH INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATION TECHNOLOGY: TOWARD NETWORK INNOVATION BEYOND EVOLUTION, VOLS 1-3, 2007, : 273 - +