Wuppertal 2015 – scientific programme
Parts | Days | Selection | Search | Updates | Downloads | Help
T: Fachverband Teilchenphysik
T 76: Grid-Computing I
T 76.2: Talk
Wednesday, March 11, 2015, 17:00–17:15, K.11.20 (K5)
Bringing ATLAS production to HPC resources - a case study with SuperMuc and Hydra — •Guenter Duckeck1, John Kennedy2, Stefan Kluth3, Luca Mazzaferro2, and Rodney Walker1 for the ATLAS collaboration — 1LMU Muenchen — 2RZG Garching — 3Max-Planck-Institut fuer Physik Muenchen
The possible usage of Supercomputer systems or HPC resources by ATLAS is now becoming viable due to the changing nature of these systems and it is also very attractive due to the need for increasing amounts of simulated data.
The ATLAS experiment at CERN will begin a period of high luminosity data taking in 2015. The corresponding need for simulated data might potentially exceed the capabilities of the current Grid infrastructure. ATLAS aims to address this need by opportunistically accessing resources such as cloud and HPC systems. This contribution presents the results of two projects undertaken by LMU/LRZ and MPP/RZG to use the supercomputer facilities SuperMuc (LRZ) and Hydra (RZG). Both are Linux based supercomputers in the 100 k CPU-core category.
The integration of such HPC resources into the ATLAS production system poses many challenges. Firstly, established techniques and features of standard WLCG operation are prohibited or much restricted on HPC systems, e.g. Grid middleware, software installation, outside connectivity, etc. Secondly, efficient use of available resources requires massive multi-core jobs, back-fill submission and check-pointing. We will discuss the customization of these components and the strategies for HPC usage as well as possibilities for future directions.