skip to main content
DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Evolution of a minimal parallel programming model

Abstract

Here, we take a historical approach to our presentation of self-scheduled task parallelism, a programming model with its origins in early irregular and nondeterministic computations encountered in automated theorem proving and logic programming. We show how an extremely simple task model has evolved into a system, asynchronous dynamic load balancing (ADLB), and a scalable implementation capable of supporting sophisticated applications on today’s (and tomorrow’s) largest supercomputers; and we illustrate the use of ADLB with a Green’s function Monte Carlo application, a modern, mature nuclear physics code in production use. Our lesson is that by surrendering a certain amount of generality and thus applicability, a minimal programming model (in terms of its basic concepts and the size of its application programmer interface) can achieve extreme scalability without introducing complexity.

Authors:
 [1];  [2];  [1]
  1. Argonne National Lab. (ANL), Argonne, IL (United States)
  2. Middle Tennessee State Univ., Murfreesboro, TN (United States)
Publication Date:
Research Org.:
Argonne National Lab. (ANL), Argonne, IL (United States)
Sponsoring Org.:
USDOE Office of Science (SC), Basic Energy Sciences (BES) (SC-22)
OSTI Identifier:
1400403
Grant/Contract Number:  
AC02-06CH11357
Resource Type:
Accepted Manuscript
Journal Name:
International Journal of High Performance Computing Applications
Additional Journal Information:
Journal Volume: 2017; Journal ID: ISSN 1094-3420
Publisher:
SAGE
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING

Citation Formats

Lusk, Ewing, Butler, Ralph, and Pieper, Steven C. Evolution of a minimal parallel programming model. United States: N. p., 2017. Web. doi:10.1177/1094342017703448.
Lusk, Ewing, Butler, Ralph, & Pieper, Steven C. Evolution of a minimal parallel programming model. United States. doi:10.1177/1094342017703448.
Lusk, Ewing, Butler, Ralph, and Pieper, Steven C. Sun . "Evolution of a minimal parallel programming model". United States. doi:10.1177/1094342017703448. https://www.osti.gov/servlets/purl/1400403.
@article{osti_1400403,
title = {Evolution of a minimal parallel programming model},
author = {Lusk, Ewing and Butler, Ralph and Pieper, Steven C.},
abstractNote = {Here, we take a historical approach to our presentation of self-scheduled task parallelism, a programming model with its origins in early irregular and nondeterministic computations encountered in automated theorem proving and logic programming. We show how an extremely simple task model has evolved into a system, asynchronous dynamic load balancing (ADLB), and a scalable implementation capable of supporting sophisticated applications on today’s (and tomorrow’s) largest supercomputers; and we illustrate the use of ADLB with a Green’s function Monte Carlo application, a modern, mature nuclear physics code in production use. Our lesson is that by surrendering a certain amount of generality and thus applicability, a minimal programming model (in terms of its basic concepts and the size of its application programmer interface) can achieve extreme scalability without introducing complexity.},
doi = {10.1177/1094342017703448},
journal = {International Journal of High Performance Computing Applications},
number = ,
volume = 2017,
place = {United States},
year = {2017},
month = {4}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 1 work
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

Charge Form Factor and Sum Rules of Electromagnetic Response Functions in C 12
journal, August 2013


The Aurora or-parallel Prolog system
journal, February 1990

  • Lusk, Ewing; Butler, Ralph; Disz, Terrence
  • New Generation Computing, Vol. 7, Issue 2-3
  • DOI: 10.1007/BF03037208

Monitors, messages, and clusters: The p4 parallel programming system
journal, April 1994


Monitors: an operating system structuring concept
journal, October 1974


Toward message passing for a million processes: characterizing MPI on a massive scale blue gene/P
journal, August 2009

  • Balaji, Pavan; Chan, Anthony; Thakur, Rajeev
  • Computer Science - Research and Development, Vol. 24, Issue 1-2
  • DOI: 10.1007/s00450-009-0095-3

Quantum Monte Carlo calculations of A = 9 , 10 nuclei
journal, October 2002


Scioto: A Framework for Global-View Task Parallelism
conference, September 2008

  • Dinan, James; Krishnamoorthy, Sriram; Larkins, D. Brian
  • 2008 37th International Conference on Parallel Processing (ICPP)
  • DOI: 10.1109/ICPP.2008.44

Linda and Friends
journal, August 1986


Legion: Expressing locality and independence with logical regions
conference, November 2012

  • Bauer, Michael; Treichler, Sean; Slaughter, Elliott
  • 2012 SC - International Conference for High Performance Computing, Networking, Storage and Analysis, 2012 International Conference for High Performance Computing, Networking, Storage and Analysis
  • DOI: 10.1109/SC.2012.71

p4-Linda: a portable implementation of Linda
conference, January 1993

  • Butler, R. M.; Leveton, A. L.; Lusk, E. L.
  • [1993] The 2nd International Symposium on High Performance Distributed Computing, [1993] Proceedings The 2nd International Symposium on High Performance Distributed Computing
  • DOI: 10.1109/HPDC.1993.263858

Experiments with resolution-based theorem-proving algorithms
journal, January 1982


Quantum Monte Carlo methods for nuclear physics
journal, September 2015


An automated reasoning system
conference, January 1981

  • Wos, L.; Winker, S. K.; Lusk, E. L.
  • Proceedings of the May 4-7, 1981, national computer conference on - AFIPS '81
  • DOI: 10.1145/1500412.1500517

Swift: A language for distributed parallel scripting
journal, September 2011


CHARM++: a portable concurrent object oriented system based on C++
conference, January 1993

  • Kale, Laxmikant V.; Krishnan, Sanjeev
  • Proceedings of the eighth annual conference on Object-oriented programming systems, languages, and applications - OOPSLA '93
  • DOI: 10.1145/165854.165874

Parallel Programming with Migratable Objects: Charm++ in Practice
conference, November 2014

  • Acun, Bilge; Gupta, Abhishek; Jain, Nikhil
  • SC14: International Conference for High Performance Computing, Networking, Storage and Analysis
  • DOI: 10.1109/SC.2014.58

Quantum Monte Carlo calculations of A = 8 nuclei
journal, June 2000