skip to main content
DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Compiler-Directed File Layout Optimization for Hierarchical Storage Systems

Abstract

File layout of array data is a critical factor that effects the behavior of storage caches, and has so far taken not much attention in the context of hierarchical storage systems. The main contribution of this paper is a compiler-driven file layout optimization scheme for hierarchical storage caches. This approach, fully automated within an optimizing compiler, analyzes a multi-threaded application code and determines a file layout for each disk-resident array referenced by the code, such that the performance of the target storage cache hierarchy is maximized. We tested our approach using 16 I/O intensive application programs and compared its performance against two previously proposed approaches under different cache space management schemes. Our experimental results show that the proposed approach improves the execution time of these parallel applications by 23.7% on average.

Authors:
 [1];  [2];  [1];  [3]
  1. The Pennsylvania State University, University Park, PA, USA
  2. Intel Corporation, University Park, PA, USA
  3. Northwestern University, Evanston, IL, USA
Publication Date:
Sponsoring Org.:
USDOE
OSTI Identifier:
1227907
Grant/Contract Number:  
SC0002156
Resource Type:
Published Article
Journal Name:
Scientific Programming
Additional Journal Information:
Journal Name: Scientific Programming Journal Volume: 21 Journal Issue: 3-4; Journal ID: ISSN 1058-9244
Publisher:
Hindawi Publishing Corporation
Country of Publication:
Egypt
Language:
English

Citation Formats

Ding, Wei, Zhang, Yuanrui, Kandemir, Mahmut, and Son, Seung Woo. Compiler-Directed File Layout Optimization for Hierarchical Storage Systems. Egypt: N. p., 2013. Web. doi:10.1155/2013/167581.
Ding, Wei, Zhang, Yuanrui, Kandemir, Mahmut, & Son, Seung Woo. Compiler-Directed File Layout Optimization for Hierarchical Storage Systems. Egypt. doi:10.1155/2013/167581.
Ding, Wei, Zhang, Yuanrui, Kandemir, Mahmut, and Son, Seung Woo. Tue . "Compiler-Directed File Layout Optimization for Hierarchical Storage Systems". Egypt. doi:10.1155/2013/167581.
@article{osti_1227907,
title = {Compiler-Directed File Layout Optimization for Hierarchical Storage Systems},
author = {Ding, Wei and Zhang, Yuanrui and Kandemir, Mahmut and Son, Seung Woo},
abstractNote = {File layout of array data is a critical factor that effects the behavior of storage caches, and has so far taken not much attention in the context of hierarchical storage systems. The main contribution of this paper is a compiler-driven file layout optimization scheme for hierarchical storage caches. This approach, fully automated within an optimizing compiler, analyzes a multi-threaded application code and determines a file layout for each disk-resident array referenced by the code, such that the performance of the target storage cache hierarchy is maximized. We tested our approach using 16 I/O intensive application programs and compared its performance against two previously proposed approaches under different cache space management schemes. Our experimental results show that the proposed approach improves the execution time of these parallel applications by 23.7% on average.},
doi = {10.1155/2013/167581},
journal = {Scientific Programming},
number = 3-4,
volume = 21,
place = {Egypt},
year = {2013},
month = {1}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record
DOI: 10.1155/2013/167581

Save / Share: