Collectively loading programs in a multiple program multiple data environment
Techniques are disclosed for loading programs efficiently in a parallel computing system. In one embodiment, nodes of the parallel computing system receive a load description file which indicates, for each program of a multiple program multiple data (MPMD) job, nodes which are to load the program. The nodes determine, using collective operations, a total number of programs to load and a number of programs to load in parallel. The nodes further generate a class route for each program to be loaded in parallel, where the class route generated for a particular program includes only those nodes on which the program needs to be loaded. For each class route, a node is selected using a collective operation to be a load leader which accesses a file system to load the program associated with a class route and broadcasts the program via the class route to other nodes which require the program.
- Research Organization:
- International Business Machines Corp., Armonk, NY (United States)
- Sponsoring Organization:
- USDOE
- Assignee:
- International Business Machines Corporation (Armonk, NY)
- Patent Number(s):
- 10,104,202
- Application Number:
- 13/801,165
- OSTI ID:
- 1487107
- Resource Relation:
- Patent File Date: 2013 Mar 13
- Country of Publication:
- United States
- Language:
- English
Similar Records
Collectively loading an application in a parallel computer
Distributing an executable job load file to compute nodes in a parallel computer