SMuK 2023 – wissenschaftliches Programm

Bereiche | Tage | Auswahl | Suche | Aktualisierungen | Downloads | Hilfe

T: Fachverband Teilchenphysik

T 62: DAQ NN/ML – GRID II

T 62.3: Vortrag

Mittwoch, 22. März 2023, 16:20–16:35, HSZ/0301

Accounting opportunistic resources with AUDITOR — •Stefan Kroboth, Michael Boehler, Dirk Sammel, and Markus Schumacher — Albert-Ludwigs-Universität Freiburg

The increasing computational demand and concerns about energy efficiency in high performance/throughput computing are driving forces in the search for more efficient ways to utilize available resources. A measure for achieving high efficiency is the sharing of idle resources of under-utilized sites with fully occupied sites. The software COBalD/TARDIS can automatically, transparently, dynamically and opportunistically integrate and disintegrate such resources. However, sharing resources also requires accounting. In this work we present AUDITOR (AccoUnting DatahandlIng Toolbox for Opportunistic Resources), a flexible and extensible accounting system that is able to cover a wide range of use cases and infrastructure. AUDITOR gathers accounting data via so-called collectors which are designed to monitor batch systems, COBalD/TARDIS, cloud schedulers or other sources of information. The data is stored in a database and provided to so-called plugins, which take an action based on accounting records. Actions can range from creating a bill, computing the CO₂ footprint, adjusting parameters of a service (i.e. priorities in a batch system) to forwarding accounting information to other accounting systems. Depending on the use case, one simply selects a suitable collector and plugin from a growing ecosystem of collectors and plugins. To facilitate the development of collectors and plugins for yet uncovered use cases by the community, libraries for interacting with AUDITOR are provided.