Göttingen 2025 – wissenschaftliches Programm

Bereiche | Tage | Auswahl | Suche | Aktualisierungen | Downloads | Hilfe

T: Fachverband Teilchenphysik

T 12: Data, AI, Computing, Electronics II (Data Management, Workflow)

T 12.3: Vortrag

Montag, 31. März 2025, 17:15–17:30, VG 2.102

Orchestrated columnar-based analysis with columnflow — •Mathis Frahm, Johannes Haller, Philip Keicher, Nathan Provoust, Marcel Rieger, Daniel Savoiu, Peter Schleper, and Matthias Schröder — Institut für Experimentalphysik, Universität Hamburg

The large datasets and increasing complexity of modern physics analysis in high energy collider physics pose a major challenge to the analysis workflows. Systems are required that can efficiently process large amounts of data, while keeping the execution of the complete analysis manageable. In this talk, we present Columnflow, a tool for columnar-based data analysis. Columnflow provides an orchestrated, yet flexible workflow that automatically handles the bookkeeping of results and dependencies. Typical analysis tasks such as propagation of systematic uncertainties, machine learning applications, and statistical inference are transparently integrated into the workflow. The implemented workflow allows the use of distributed computing resources and is fully configurable, yet accessible to newcomers.

Keywords: Columnar; Orchestrated; Automated; Framework; Law