Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Data management for high energy physics experiments: Preliminary proposals

Conference ·
OSTI ID:6641106

Currently HEP experimental data are reduced as they become available. We propose instead a ''demand driven'' approach to data analysis. Full analysis will be performed only as needed, in response to user queries which specify the subset of events for which reduced data is needed. To support this approach we propose to partition the datasets on the cross product of several trigger inputs, instead of storing the data in chronological order. Queries will be automatically decomposed into a set of requests against several partitions. Indexing, physically clustering the data on the logical partitions, and caching of partitions will be employed for efficiency.

Research Organization:
Lawrence Berkeley Lab., CA (USA)
DOE Contract Number:
AC03-76SF00098
OSTI ID:
6641106
Report Number(s):
LBL-22883; CONF-870249-4; ON: DE87006940
Country of Publication:
United States
Language:
English