D0 data processing within EDG/LCG
In September 2003, the D0 experiment at TEvatron has launched a reprocessing effort. In total 519,212,822 of the experiment's events have been reprocessed to use the new perceptions of the detector's behavior. Out of these events 97,619,114 have been reprocessed at remote sites. For the first time, the European DataGRID has been used to re-process a part of these events as an evaluation of the EDG application testbed. They used EDG's own R-GMA database for monitoring and bookkeeping and constructed four tables: (1) submission table--records the submission of jobs to the Resource Broker; (2) job start table--holds the time the job started on a Worker Node together with process ID and many more; (3) job end table--information is published immediately before the job stops; and (4) command table--a command list table for debugging purposes. As D0 has its own data management system called ''SAM'', some sort of channel between SAM and the EDG data management system is required. The approach used is shown to the left, were a certain storage area, physically present on a back-end server machine, is visible both from a SAM-enabled machine (''SAM station'') and from EDG machines at the same site. This has bene achieved at NIKHEF. The D0 software has been adapted to run in the EDG framework. Only a few changes has to be made. Missing libraries were included and some extra packages were shipped (pyxml and Python 2.1). However, arounding wrapper scripts were written to handle the in- and output and put/get it from/to EDG's Data Management System (DMS).
- Research Organization:
- Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
- Sponsoring Organization:
- USDOE
- DOE Contract Number:
- AC02-76CH03000
- OSTI ID:
- 15016959
- Report Number(s):
- FERMILAB-CONF-04-477-CD; TRN: US0605168
- Resource Relation:
- Conference: Prepared for Computing in High-Energy Physics (CHEP '04), Interlaken, Switzerland, 27 Sep - 1 Oct 2004
- Country of Publication:
- United States
- Language:
- English
Similar Records
Testing the CDF distributed computing framework
Production Operations Management System (POMS) for Fermilab Experiments