Skip to content

Run workflows via snakemake / parsl

Lars Bilke requested to merge bilke/ogs:ctest-pre-script into master

This introduces a prototypical usage of two workflow management systems: Snakemake and Parsl.

As a showcase I replaced the ExtractBoundary tests with a Snakemake and a Parsl (Linux, macOS only) workflow.

Could be a possible implementation of #3006 (closed). What do you think?

Both systems create a directed-acyclic glyph (DAG) with data dependencies between the steps. Both are written in Python although Snakemake uses a domain-specific language like syntax. They are both actively developed.

We do not need to decide on systems yet, maybe we have to use them more to see which fits better or we even use both...

Edited by Lars Bilke

Merge request reports