Towards Dynamic Resource Management with MPI Sessions and PMIx - AIRSEA Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

Towards Dynamic Resource Management with MPI Sessions and PMIx

Résumé

Job management software on peta- and exascale supercomputers continues to provide static resource allocations, from a program’s start until its end. Dynamic resource allocation and management is a research direction that has the potential to improve the efficiency of HPC systems and applications by dynamically adapting the resources of an application during its runtime. Resources can be adapted based on past, current or even future system conditions and matching optimization targets. However, the implementation of dynamic resource management is challenging as it requires support across many layers of the software stack, including the programming model. In this paper, we focus on the latter and present our approach to extend MPI Sessions to support dynamic resource allocations within MPI applications. While some forms of dynamicity already exist in MPI, it is currently limited by requiring global synchronization, being application or application-domain specific, or by suffering from limited support in current HPC system software stacks. We overcome these limitations with a simple, yet powerful abstraction: resources as process sets, and changes of resources as set operations leading to a graph-based perspective on resource changes. As the main contribution of this work, we provide an implementation of this approach based on MPI Sessions and PMIx. In addition, an illustration of its usage is provided, as well as a discussion about the required extensions of the PMIx standard. We report results based on a prototype implementation with Open MPI using a synthetic application, as well as a PDE solver benchmark on up to four nodes and a total of 112 cores. Overall, our results show the feasibility of our approach, which has only very moderate overheads. We see this first proof-of-concept as an important step towards resource adaptivity based on MPI Sessions.
Fichier principal
Vignette du fichier
2022_huber_et_al_towards_drm_with_sessions_and_pmix (1).pdf (587.79 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03856697 , version 1 (16-11-2022)

Identifiants

Citer

Dominik Huber, Maximilian Streubel, Isaías Comprés, Martin Schulz, Martin Schreiber, et al.. Towards Dynamic Resource Management with MPI Sessions and PMIx. EuroMPI/USA'22 - 29th European MPI Users' Group Meeting, Sep 2022, Chattanooga, United States. pp.57-67, ⟨10.1145/3555819.3555856⟩. ⟨hal-03856697⟩
37 Consultations
164 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More