Interstitial computing : utilizing spare cycles on supercomputers.
- Woodside, CA
This paper presents an analysis of utilizing unused cycles on supercomputers through the use of many small jobs. What we call 'interstitial computing,' is important to supercomputer centers for both productivity and political reasons. Interstitial computing makes use of the fact that small jobs are more or less fungible consumers of compute cycles that are more efficient for bin packing than the typical jobs on a supercomputer. An important feature of interstitial computing is that it not have a significant impact on the makespan of native jobs on the machine. Also, a facility can obtain higher utilizations that may only be otherwise possible with more complicated schemes or with very long wait times. The key contribution of this paper is that it provides theoretical and empirical guidelines for users and administrators for how currently unused supercomputer cycles may be exploited. We find that that interstitial computing is a more effective means for increasing machine utilization than increasing native job run times or size.
- Research Organization:
- Sandia National Laboratories
- Sponsoring Organization:
- USDOE
- DOE Contract Number:
- AC04-94AL85000
- OSTI ID:
- 1005396
- Report Number(s):
- SAND2003-3444C
- Country of Publication:
- United States
- Language:
- English
Similar Records
Fair share on high performance computing systems : what does fair really mean?
Integration of Titan supercomputer at OLCF with ATLAS Production System