Job monitoring and steering in D-Grid’s High Energy Physics Community Grid

• Published in: Future generation computer systems Vol. 25; no. 3; pp. 308 - 314
• Main Authors: Lorenz, D., Borovac, S., Buchholz, P., Eichenhardt, H., Harenberg, T., Mättig, P., Mechtel, M., Müller-Pfefferkorn, R., Neumann, R., Reeves, K., Uebing, Ch, Walkowiak, W., William, Th, Wismüller, R.
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 01.03.2009
• Subjects: Computational steering; Grid computing; High Energy Physics Community Grid; Job monitoring; Grid computing; Job monitoring; High Energy Physics Community Grid; Computational steering
• ISSN: 0167-739X; 1872-7115
• DOI: 10.1016/j.future.2008.05.009

In the High Energy Physics Comunity Grid (HEPCG) of Germany’s D-Grid initiative, a suite of tools supporting the user in monitoring his jobs was developed. In the HEP community many users submit large numbers of jobs. A considerable fraction of these jobs fail for various reasons. Until now, it has been hard or even impossible for the user to find the reason for the job failure. The AMon tool supports the user with a graphical web-based overview on status and resource usage of his jobs. The script wrapper JEM (Job Execution Monitor) monitors a job’s environment giving detailed information about the job execution. Finally, once the job itself is running, a computational steering tool allows the user to interact with his job at runtime, to visualize intermediate results, and to modify job parameters.