Title
A job dispatcher for large and heterogeneous HPC systems running modern applications
Date Issued
01 October 2021
Access level
metadata only access
Resource Type
conference paper
Author(s)
Galleguillos C.
Kiziltan Z.
Pontificia Universidad Católica de Valparaíso
Publisher(s)
Schloss Dagstuhl- Leibniz-Zentrum fur Informatik GmbH, Dagstuhl Publishing
Abstract
High-performance Computing (HPC) systems have become essential instruments in our modern society. As they get closer to exascale performance, HPC systems become larger in size and more heterogeneous in their computing resources. With recent advances in AI, HPC systems are also increasingly being used for applications that employ many short jobs with strict timing requirements. HPC job dispatchers need to therefore adopt techniques to go beyond the capabilities of those developed for small or homogeneous systems, or for traditional compute-intensive applications. In this paper, we present a job dispatcher suitable for today's large and heterogeneous systems running modern applications. Unlike its predecessors, our dispatcher solves the entire dispatching problem using Constraint Programming (CP) with a model size independent of the system size. Experimental results based on a simulation study show that our approach can bring about significant performance gains over the existing CP-based dispatchers in a large or heterogeneous system.
Volume
210
Language
English
OCDE Knowledge area
Matemáticas Ingeniería de sistemas y comunicaciones
Scopus EID
2-s2.0-85118179048
ISBN
9783959772112
ISSN of the container
18688969
ISBN of the container
978-395977211-2
Conference
Leibniz International Proceedings in Informatics, LIPIcs
Sources of information: Directorio de Producción Científica Scopus