MCRUNJOB: A High energy physics workflow planner for grid production processing
McRunjob is a powerful grid workflow manager used to manage the generation of large numbers of production processing jobs in High Energy Physics. In use at both the DZero and CMS experiments, McRunjob has been used to manage large Monte Carlo production processing since 1999 and is being extended to uses in regular production processing for analysis and reconstruction. Described at CHEP 2001, McRunjob converts core metadata into jobs submittable in a variety of environments. The powerful core metadata description language includes methods for converting the metadata into persistent forms, job descriptions, multi-step workflows, and data provenance information. The language features allow for structure in the metadata by including full expressions, namespaces, functional dependencies, site specific parameters in a grid environment, and ontological definitions. It also has simple control structures for parallelization of large jobs. McRunjob features a modular design which allows for easy expansion to new job description languages or new application level tasks.
- Research Organization:
- Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
- Sponsoring Organization:
- USDOE Office of Energy Research (ER) (US)
- DOE Contract Number:
- AC02-76CH03000
- OSTI ID:
- 828633
- Report Number(s):
- FERMILAB-Conf-03/483-CD; TRN: US0404047
- Resource Relation:
- Conference: 2003 CONFERENCE FOR COMPUTING IN HIGH-ENERGY AND NUCLEAR Physics (CHEP 03), La Jolla, CA (US), 03/24/2003--03/28/2003; Other Information: PBD: 26 Aug 2004
- Country of Publication:
- United States
- Language:
- English
Similar Records
ROBOT: A Tool for Automating Ontology Workflows
ReSS: A Resource Selection Service for the Open Science Grid