System-level fault-tolerance in large-scale parallel machines with buffered coscheduling
- Fabrizio
- Jose Carlos
As the number of processors for multi-teraflop systems grows to tens of thousands, with proposed petaflops systems likely to contain hundreds of thousands of processors, the assumption of fully reliable hardware has been abandoned. Although the mean time between failures for the individual Components can be very high, the large total component count will inevitably lead to frequent failures. It is therefore ofparamount importance to develop new software solutions to deal with the unavoidable reality of hardware faults. In this paper we will first describe the nature of the failures of current large-scale machines, and extrapolate these results to future machines. Based on this preliminary analysis we will present a new technology that we are currently developing, buffered coscheduling, which seeks to implement fault tolerance at the operating system level. Major design goals include dynamic reallocation of resources to allow continuing execution in the presence of hardware failures, very high scalability, high eficiency (low overhead), and transparency-requiring no changes to user applications. Preliminary results show that this is attainable with current hardware.
- Research Organization:
- Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
- Sponsoring Organization:
- USDOE
- OSTI ID:
- 977449
- Report Number(s):
- LA-UR-04-0694; LA-UR-04-694; TRN: US201009%%773
- Resource Relation:
- Conference: Submitted to: IPDPS 2004, April 2004, Santa Fe, NM
- Country of Publication:
- United States
- Language:
- English
Similar Records
A New coscheduling technique for a cluster of symmetric multiprocessors
Coscheduling Technique for Symmetric Multiprocessor Clusters