File migration on the Cray Y-MP at the National Center for Atmospheric Research

Book · Tue Jan 01 04:00:00 EST 1991

OSTI ID:7296992

Miller, E L

The supercomputer center at the National Center for atmospheric Research (NCAR) migrates large numbers of files to and from its mass storage system (MSS) because there is insufficient space to store them on the Cray supercomputer's local disks. This paper presents file migration data collected over a 10 month period and some analysis of the data. The analysis shows that requests to the MSS are periodic, with one day and one week periods. Read requests to the MSS account for the majority of the periodicity; write requests are relatively constant over the course of a week. The intervals between requests to the MSS appear to be bunched, since well over half of the intervals are shorter than half the mean interval length. The latencies to access the first byte from disk, automated tape library, and manually-mounted tape are examined. In addition, information about file size distribution is given. The authors found that the NCAR system was different from systems studied earlier in several ways, including the ratio of local disk to tertiary storage. These differences affect the way that file migration can be done, so previous migration algorithms may not be effective.

• OSTI ID: 7296992
• Country of Publication: United States
• Language: English

Related Subjects

54 ENVIRONMENTAL SCIENCES
540120 -- Environment
Atmospheric-- Chemicals Monitoring & Transport-- (1990-)
99 GENERAL AND MISCELLANEOUS
990200* -- Mathematics & Computers
990300 -- Information Handling
ALGORITHMS
ATMOSPHERIC CHEMISTRY
AUTOMATION
CHEMISTRY
COMPUTERS
CRAY COMPUTERS
DATA PROCESSING
DISTRIBUTED DATA PROCESSING
MATHEMATICAL LOGIC
PARALLEL PROCESSING
PROCESSING
PROGRAMMING
RESEARCH PROGRAMS