Workload management in the EMI project

• Published in: Journal of physics. Conference series Vol. 396; no. 3; pp. 32021 - 7
• Main Authors: Andreetto, Paolo, Bertocco, Sara, Capannini, Fabio, Cecchi, Marco, Dorigo, Alvise, Frizziero, Eric, Gianelle, Alessio, Kretsis, Aristotelis, Mezzadri, Massimo, Monforte, Salvatore, Prelz, Francesco, Rebatto, David, Sgaravatto, Massimo, Zangrando, Luigi
• Format: Journal Article
• Language: English
• Published: Bristol IOP Publishing 01.01.2012
• Subjects: Computation; Computer networks; Delivery scheduling; Distributed processing; Electromagnetic interference; Interoperability; Management; Middleware; Physics; Project management; Reporting; Workload; Workloads
• ISSN: 1742-6588; 1742-6596
• DOI: 10.1088/1742-6596/396/3/032021

The EU-funded project EMI, now at its second year, aims at providing a unified, high quality middleware distribution for e-Science communities. Several aspects about workload management over diverse distributed computing environments are being challenged by the EMI roadmap: enabling seamless access to both HTC and HPC computing services, implementing a commonly agreed framework for the execution of parallel computations and supporting interoperability models between Grids and Clouds. Besides, a rigourous requirements collection process, involving the WLCG and various NGIs across Europe, assures that the EMI stack is always committed to serving actual needs. With this background, the gLite Workload Management System (WMS), the meta-scheduler service delivered by EMI, is augmenting its functionality and scheduling models according to the aforementioned project roadmap and the numerous requirements collected over the first project year. This paper is about present and future work of the EMI WMS, reporting on design changes, implementation choices and longterm vision.