Göttingen 2025 – wissenschaftliches Programm

Bereiche | Tage | Auswahl | Suche | Aktualisierungen | Downloads | Hilfe

AKPIK: Arbeitskreis Physik, moderne Informationstechnologie und Künstliche Intelligenz

AKPIK 4: Simulation and Workflows

AKPIK 4.3: Vortrag

Freitag, 4. April 2025, 09:30–09:45, Theo 0.134

Parametrizing workflows with ParaO and Luigi — Martin Erdmann and •Benjamin Fischer — III. Physikalisches Institut A, RWTH Aachen University

Workflow tools provide the means to codify complex multi-step processes, thus enabling reproducibility, preservation, and reinterpretation efforts. Their powerful bookkeeping also directly supports the research process, especially where intermediate results are produced, inspected, and iterated upon frequently.

In Luigi, such a complex workflow graph is composed of individual tasks that depend on one another, where every part can be customized at runtime through parametrization. However, Luigi falls short with regards to the steering of parameters, accounting for the consequences thereof, and the modification or reuse of task graphs.

This is where the parameter handling of ParaO shines: it has vastly extended key mechanics and value coercion while automatically propagating their effects throughout the task graph. Since the dependencies are described through parameters too, the same principles can be used to freely alter or transplant (parts of) the task graph, thereby empowering reuse. At the same time, ParaO remains largely compatible with plain Luigi and packages building upon it, such as Law.

Keywords: workflows; luigi; analyses