Model of parallel performance. Final report, July-December 1988
This report introduces a general model of parallel performance. With the goal of developing conceptual and empirical methods for characterizing and understanding parallel algorithms, new definitions of speedup and efficiency were formulated. These definitions take into account the effects that problem size and the number of processors have on efficiency and speedup, and provide a natural and quantifiable measure of parallel performance. The terms introduced in the definitions provide new and improved interpretations of the 'serial' and 'parallel' fraction parameters commonly used in the literature (i.e., Amdahl's Law) to explain the behavior of parallel algorithms. The model provides a more complete characterization of parallel algorithm behavior and is used to correct apparent deficiencies in the formulation of speedup as expressed by Amdahl's Law. Chapter 2 of this report reviews the basic definitions of speedup and efficiency and introduces new definitions of these quantities in terms of work units and presents two illustrative examples. Chapter 3 discusses two models of parallel performance that appear in the parallel computing literature. The two formulations of speedup and efficiency are based on the notion of 'serial' and 'parallel' fractions and present an apparent dichotomy that must be resolved. Then, the 'serial' and 'parallel' fractions are expressed in terms of the new work quantities introduced in Chapter 2, providing a natural interpretation of the serial and parallel fractions of a task. The resulting equations are used to reconcile the (apparent) dichotomy between Amdahl's Law and the more recent formulation of speedup.
- Research Organization:
- Air Force Weapons Lab., Kirtland AFB, NM (USA)
- OSTI ID:
- 5626412
- Report Number(s):
- AD-A-207792/3/XAB; AFWL-TR-89-01
- Country of Publication:
- United States
- Language:
- English
Similar Records
A parallel formulation of interior point algorithms
A performance model for massive parallelism