skip to main content

DOE PAGESDOE PAGES

Title: Trends in data locality abstractions for HPC systems

The cost of data movement has always been an important concern in high performance computing (HPC) systems. It has now become the dominant factor in terms of both energy consumption and performance. Support for expression of data locality has been explored in the past, but those efforts have had only modest success in being adopted in HPC applications for various reasons. However, with the increasing complexity of the memory hierarchy and higher parallelism in emerging HPC systems, locality management has acquired a new urgency. Developers can no longer limit themselves to low-level solutions and ignore the potential for productivity and performance portability obtained by using locality abstractions. Fortunately, the trend emerging in recent literature on the topic alleviates many of the concerns that got in the way of their adoption by application developers. Data locality abstractions are available in the forms of libraries, data structures, languages and runtime systems; a common theme is increasing productivity without sacrificing performance. Furthermore, this paper examines these trends and identifies commonalities that can combine various locality concepts to develop a comprehensive approach to expressing and managing data locality on future large-scale high-performance computing systems.
Authors:
ORCiD logo [1] ;  [2] ;  [3] ;  [4] ; ORCiD logo [5] ;  [6] ;  [7] ;  [8] ;  [9] ;  [10] ;  [11] ;  [12] ;  [13] ;  [14] ;  [15] ;  [16] ;  [9] ;  [17] ;  [18] ;  [19] more »; ORCiD logo [20] « less
  1. Koc Univ., Istanbul (Turkey)
  2. Argonne National Lab. (ANL), Lemont, IL (United States)
  3. ETH Zurich, Zurich (Switzerland)
  4. Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
  5. KTH Royal Institute of Technology, Solna (Sweden)
  6. Swiss National Supercomputer, Lugano (Switzerland)
  7. Cray Inc., Seattle, WA (United States)
  8. Intel Corp., Santa Clara, CA (United States)
  9. Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
  10. Argonne National Lab. (ANL), Argonne, IL (United States)
  11. Ludwig-Maximilians-Univ., Munich (Germany)
  12. Univ. of Erlangen-Nuremberg, Erlangen (Germany)
  13. INRIA Bordeaux Sud-Ouest, Talence (France)
  14. Univ. of Michigan, Ann Arbor, MI (United States)
  15. Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
  16. Imperial College, London (United Kingdom)
  17. King Abdullah Univ. of Science and Technology, Thuwal (Saudia Arabia)
  18. RIKEN, Hyogo (Japan)
  19. Nvidia Corp., Santa Clara, CA (United States)
  20. Chalmers Univ. of Technology, Goteborg (Sweden)
Publication Date:
Report Number(s):
SAND-2017-3844J
Journal ID: ISSN 1045-9219; 652425
Grant/Contract Number:
AC04-94AL85000
Type:
Accepted Manuscript
Journal Name:
IEEE Transactions on Parallel and Distributed Systems
Additional Journal Information:
Journal Volume: 28; Journal Issue: 10; Journal ID: ISSN 1045-9219
Publisher:
IEEE
Research Org:
Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Sponsoring Org:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR) (SC-21)
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING; data locality; programming abstractions; high-performance computing; data layout; locality-aware runtimes
OSTI Identifier:
1356837

Unat, Didem, Dubey, Anshu, Hoefler, Torsten, Shalf, John, Abraham, Mark, Bianco, Mauro, Chamberlain, Bradford L., Cledat, Romain, Edwards, H. Carter, Finkel, Hal, Fuerlinger, Karl, Hannig, Frank, Jeannot, Emmanuel, Kamil, Amir, Keasler, Jeff, Kelly, Paul H. J., Leung, Vitus, Ltaief, Hatem, Maruyama, Naoya, Newburn, Chris J., and Pericas, Miquel. Trends in data locality abstractions for HPC systems. United States: N. p., Web. doi:10.1109/tpds.2017.2703149.
Unat, Didem, Dubey, Anshu, Hoefler, Torsten, Shalf, John, Abraham, Mark, Bianco, Mauro, Chamberlain, Bradford L., Cledat, Romain, Edwards, H. Carter, Finkel, Hal, Fuerlinger, Karl, Hannig, Frank, Jeannot, Emmanuel, Kamil, Amir, Keasler, Jeff, Kelly, Paul H. J., Leung, Vitus, Ltaief, Hatem, Maruyama, Naoya, Newburn, Chris J., & Pericas, Miquel. Trends in data locality abstractions for HPC systems. United States. doi:10.1109/tpds.2017.2703149.
Unat, Didem, Dubey, Anshu, Hoefler, Torsten, Shalf, John, Abraham, Mark, Bianco, Mauro, Chamberlain, Bradford L., Cledat, Romain, Edwards, H. Carter, Finkel, Hal, Fuerlinger, Karl, Hannig, Frank, Jeannot, Emmanuel, Kamil, Amir, Keasler, Jeff, Kelly, Paul H. J., Leung, Vitus, Ltaief, Hatem, Maruyama, Naoya, Newburn, Chris J., and Pericas, Miquel. 2017. "Trends in data locality abstractions for HPC systems". United States. doi:10.1109/tpds.2017.2703149. https://www.osti.gov/servlets/purl/1356837.
@article{osti_1356837,
title = {Trends in data locality abstractions for HPC systems},
author = {Unat, Didem and Dubey, Anshu and Hoefler, Torsten and Shalf, John and Abraham, Mark and Bianco, Mauro and Chamberlain, Bradford L. and Cledat, Romain and Edwards, H. Carter and Finkel, Hal and Fuerlinger, Karl and Hannig, Frank and Jeannot, Emmanuel and Kamil, Amir and Keasler, Jeff and Kelly, Paul H. J. and Leung, Vitus and Ltaief, Hatem and Maruyama, Naoya and Newburn, Chris J. and Pericas, Miquel},
abstractNote = {The cost of data movement has always been an important concern in high performance computing (HPC) systems. It has now become the dominant factor in terms of both energy consumption and performance. Support for expression of data locality has been explored in the past, but those efforts have had only modest success in being adopted in HPC applications for various reasons. However, with the increasing complexity of the memory hierarchy and higher parallelism in emerging HPC systems, locality management has acquired a new urgency. Developers can no longer limit themselves to low-level solutions and ignore the potential for productivity and performance portability obtained by using locality abstractions. Fortunately, the trend emerging in recent literature on the topic alleviates many of the concerns that got in the way of their adoption by application developers. Data locality abstractions are available in the forms of libraries, data structures, languages and runtime systems; a common theme is increasing productivity without sacrificing performance. Furthermore, this paper examines these trends and identifies commonalities that can combine various locality concepts to develop a comprehensive approach to expressing and managing data locality on future large-scale high-performance computing systems.},
doi = {10.1109/tpds.2017.2703149},
journal = {IEEE Transactions on Parallel and Distributed Systems},
number = 10,
volume = 28,
place = {United States},
year = {2017},
month = {5}
}