Parts | Days | Selection | Search | Updates | Downloads | Help

T: Fachverband Teilchenphysik

T 68: Data, AI, Computing 6 (ML utilities)

T 68.4: Talk

Wednesday, March 6, 2024, 16:45–17:00, Geb. 30.34: LTI

Ahead-of-time (AOT) compilation of Tensorflow models — •Bogdan Wiederspan, Marcel Rieger, and Peter Schleper — Universität Hamburg

In a wide range of high-energy particle physics analyses, machine learning methods have proven as powerful tools to enhance analysis sensitivity. In the past years, various machine learning applications were also integrated in central CMS workflows, leading to great improvements in reconstruction and object identification efficiencies.

However, the continuation of successful deployments might be limited in the future due to memory and processing time constraints of more advanced models evaluated on central infrastructure.

A novel inference approach for models trained with TensorFlow, based on Ahead-of-time (AOT) compilation is presented. This approach offers a substantial reduction in memory footprints while preserving or even improving computational performance.

This talk outlines strategies and limitations of this novel approach, and presents integration workflow for deploying AOT models in production.

Keywords: tensorflow; ressources; ahead-of-time; machine learning