skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Data archiving in experimental physics

Abstract

In experimental physics, data is archived from a wide variety of sources and used for a wide variety of purposes. In each of these environments, trade-offs are made between data storage rate, data availability, and retrieval rate. This paper presents archive alternatives in EPICS, the overall archiver design and details on the data collection and retrieval requirements, performance studies, design choices, design alternatives, and measurements made on the beta version of the archiver.

Authors:
; ;  [1];  [2]
  1. Jefferson Lab., Newport News, VA (United States)|[Los Alamos National Lab., NM (United States)
  2. Deutches Elektronen Synchrotronen (Germany)|[Los Alamos National Lab., NM (United States)
Publication Date:
Research Org.:
Los Alamos National Lab., NM (United States)
Sponsoring Org.:
USDOE, Washington, DC (United States)
OSTI Identifier:
663215
Report Number(s):
LA-UR-98-204; CONF-971171-
ON: DE98003469; TRN: 99:000139
DOE Contract Number:
W-7405-ENG-36
Resource Type:
Conference
Resource Relation:
Conference: 1997 international conference on accelerator and large experimental physics control systems, Beijing (China), 3-9 Nov 1997; Other Information: PBD: [1998]
Country of Publication:
United States
Language:
English
Subject:
43 PARTICLE ACCELERATORS; 99 MATHEMATICS, COMPUTERS, INFORMATION SCIENCE, MANAGEMENT, LAW, MISCELLANEOUS; COMPUTERIZED CONTROL SYSTEMS; DATA ACQUISITION; INFORMATION RETRIEVAL; MEMORY DEVICES; ACCELERATORS; DATA PROCESSING; DATA ACQUISITION SYSTEMS

Citation Formats

Dalesio, L.R., Watson, W. III, Bickley, M., and Clausen, M. Data archiving in experimental physics. United States: N. p., 1998. Web.
Dalesio, L.R., Watson, W. III, Bickley, M., & Clausen, M. Data archiving in experimental physics. United States.
Dalesio, L.R., Watson, W. III, Bickley, M., and Clausen, M. 1998. "Data archiving in experimental physics". United States. doi:. https://www.osti.gov/servlets/purl/663215.
@article{osti_663215,
title = {Data archiving in experimental physics},
author = {Dalesio, L.R. and Watson, W. III and Bickley, M. and Clausen, M.},
abstractNote = {In experimental physics, data is archived from a wide variety of sources and used for a wide variety of purposes. In each of these environments, trade-offs are made between data storage rate, data availability, and retrieval rate. This paper presents archive alternatives in EPICS, the overall archiver design and details on the data collection and retrieval requirements, performance studies, design choices, design alternatives, and measurements made on the beta version of the archiver.},
doi = {},
journal = {},
number = ,
volume = ,
place = {United States},
year = 1998,
month = 7
}

Conference:
Other availability
Please see Document Availability for additional information on obtaining the full-text document. Library patrons may search WorldCat to identify libraries that hold this conference proceeding.

Save / Share:
  • This bibliography contains citations concerning the digital image networks and picture archiving and communication systems (PACS) utilized is medical imaging. PACS refers to a technology that manages the vast amount of radiological images and information by means of computer network for the purpose of archiving, distributing, communicating, displaying, and processing the data throughout the radiology service and hospital complex. This emerging concept as the product of many advances in computer technologies such as digital image generation, digital image processing, high-density mass electronic storage, data communication, data base management systems, and electronic display systems. The following major subsystems are also dealtmore » with: data base management systems; workstations; interfacing with subsystems; communication systems; and other devices. Descriptions of specific systems are included. (Contains 157 citations fully indexed and including a title list.)« less
  • The Next-Generation Ecosystem Experiments (NGEE Arctic) project is committed to implementing a rigorous and high-quality data management program. The goal is to implement innovative and cost-effective guidelines and tools for collecting, archiving, and sharing data within the project, the larger scientific community, and the public. The NGEE Arctic web site is the framework for implementing these data management and data sharing tools. The open sharing of NGEE Arctic data among project researchers, the broader scientific community, and the public is critical to meeting the scientific goals and objectives of the NGEE Arctic project and critical to advancing the mission ofmore » the Department of Energy (DOE), Office of Science, Biological and Environmental (BER) Terrestrial Ecosystem Science (TES) program.« less
  • During the past 15 years, increasing numbers of organizations and planning agencies have begun collecting high-resolution Global Positioning System (GPS) travel data. Despite the significant effort and expense to collect it, privacy concerns often lead to underutilization of the data. To address this dilemma of providing data access while preserving privacy, the National Renewable Energy Laboratory, with support from the U.S. Department of Transportation and U.S. Department of Energy, established the Transportation Secure Data Center (TSDC). Lessons drawn from best-practice examples from other data centers have helped shape the structure and operating procedures for the TSDC, which functions under themore » philosophy of first and foremost preserving privacy, but doing so in a way that balances security with accessibility and usability of the data for legitimate research. This paper provides details about the TSDC approach toward achieving these goals, which has included creating a secure enclave with no external access for backing up and processing raw data, a publicly accessible website for downloading cleansed data, and a secure portal environment through which approved users can work with detailed spatial data using a variety of tools and reference information. This paper also describes lessons learned from operating the TSDC with respect to improvements in GPS data handling, processing, and user support, along with plans for continual enhancements to better support the needs of both data providers and users and to thus advance the research value derived from such valuable data.« less
  • Critical experiment facilities produced a large number of important data during the past 45 years; however, many useful data remain unpublished. The unpublished material exists in the form of experimenters' logbooks, notes, photographs, material descriptions, etc., This data could be important for computer code validation, understanding the physics of criticality, facility design, or for setting process limits. In the past, criticality specialists have been able to obtain unpublished details by direct contact with the experimenters. Obviously, this will not be possible indefinitely. Most of the US critical experiment facilities are now closed, and the experimenters are moving to other jobs,more » retiring, or otherwise becoming unavailable for this informal assistance. Also, the records are in danger of being discarded or lost during facility closures, cleanup activities, or in storage. A project was begun in 1989 to ensure that important unpublished data from critical experiment facilities in the United States are archived and made available as a resource of the US Department of Energy's (DOE's) Nuclear Criticality Information System (NCIS). The objective of this paper is to summarize the project accomplishments to date and bring these activities to the attention of those who might be aware of the location of source information needed for archiving and could assist in getting the materials included in the archive.« less
  • Computer support of a tokamak fusion experiment for the purpose of data acquisition, analysis, and archiving required handling the large amounts of data generated each shot, and presenting the data for both individual diagnostic experiments and shot summary in a timely and useful manner. A distributed computer system with processing at three levels supports General Atomic's Doublet III tokamak by providing: (1) acquisition and permanent archiving of all diagnostic data, (2) analysis and control for each physics diagnostic, (3) overall shot summary after each shot, and (4) detailed analysis of current and post shot data.