The multicomputer toolbox: Scalable parallel libraries for large-scale concurrent applications
In this paper, we consider what is required to develop parallel algorithms for engineering applications on message-passing concurrent computers. At Caltech, the first author studied the concurrent dynamic simulation of distillation column networks. This research was accomplished with attention to portability, high performance and reusability of the underlying algorithms. Emerging from this work are several key results: first, a methodology for explicit parallelization of algorithms and for the evaluation of parallel algorithms in the distributed-memory context; second, a set of portable, reusable numerical algorithms constituting a Multicomputer Toolbox,'' suitable for use on both existing and future medium-grain concurrent computers; third, a working prototype simulation system, Cdyn, for distillation problems, that can be enhanced to address more complex flowsheeting problems in chemical engineering; fourth, ideas for how to achieve higher performance with Cdvn, using iterative methods for the underlying linear algebra. Of these, the chief emphasis in the present paper is the reusable collection of parallel libraries comprising the Toolbox. Concurrent algorithms for the solution of dense and sparse linear systems, and ordinary differential-algebraic equations were developed as part of this work. Importantly, we have embedded the notion of data distribution independence--support for algorithmic correctness independent of data locality choices--into the underlying methodology and practical software. This together with carefully designed message passing primitives, and concurrent data structures encapsulating data layout of matrices and vectors, provides an excellent basis for building and then tuning the performance of whole applications, rather than single computational steps.
- Research Organization:
- Lawrence Livermore National Lab., CA (United States)
- Sponsoring Organization:
- DOE; USDOE, Washington, DC (United States)
- DOE Contract Number:
- W-7405-ENG-48
- OSTI ID:
- 5503249
- Report Number(s):
- UCRL-JC-109251; CONF-920730--2; ON: DE92008068
- Country of Publication:
- United States
- Language:
- English
Similar Records
The multicomputer toolbox approach to concurrent BLAS and LACs
The multicomputer toolbox approach to concurrent BLAS and LACs