Parallel Programming Models and Systems for High Performance Computing. In: Emerging Research in Cloud Distributed Computing Systems

Venkata, Manjunath Gorentia; Poole, Stephen

doi:10.4018/978-1-4666-8213-9.ch008

Title: Parallel Programming Models and Systems for High Performance Computing. In: Emerging Research in Cloud Distributed Computing Systems

Book · Thu Jan 01 00:00:00 EST 2015

DOI:https://doi.org/10.4018/978-1-4666-8213-9.ch008· OSTI ID:1567681

Venkata, Manjunath Gorentia ^[1]; Poole, Stephen ^[1]

Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)

A parallel programming model is an abstraction of a parallel system that allows expression of both algorithms and shared data structures. To accommodate the diversity in parallel system architectures and user requirements, there are a variety of programming models including the models providing a shared memory view or a distributed memory view of the system. The programming models are implemented as libraries, language extensions, or compiler directives. This chapter provides a discussion on programming models and its implementations aimed at application developers, system software researchers, and hardware architects. The first part provides an overview of the programming models. The second part is an in-depth discussion on high-performance networking interface to implement the programming model. The last part of the chapter discusses implementation of a programming model with a case study. Each part of the chapter concludes with a discussion on current research trends and its impact on future architectures.

OSTI does not have a digital full text copy available. For more information, please see document availability, search WorldCat, or search Google Scholar.

Cite

Export

Save

Research Organization:: Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)

Sponsoring Organization:: USDOE Office of Science (SC)

OSTI ID:: 1567681

Country of Publication:: United States

Language:: English

References (26)

The Gemini System Interconnect Alverson, Robert; Roweth, Duncan; Kaplan, Larry 2010 IEEE 18th Annual Symposium on High-Performance Interconnects (HOTI), 2010 18th IEEE Symposium on High Performance Interconnects https://doi.org/10.1109/HOTI.2010.23	conference	August 2010
Architecture of LA-MPI, a network-fault-tolerant MPI Aulwes, R. T.; Daniel, D. J.; Desai, N. N. 18th International Parallel and Distributed Processing Symposium, 2004. Proceedings. https://doi.org/10.1109/IPDPS.2004.1302920	conference	January 2004
The IBM external user interface for scalable parallel systems Bala, Vasanth; Bruck, Jehoshua; Bryant, Raymond Parallel Computing, Vol. 20, Issue 4 https://doi.org/10.1016/0167-8191(94)90022-1	journal	April 1994
Hobbes: composition and virtualization as the foundations of an extreme-scale OS/R Brightwell, Ron; Oldfield, Ron; Maccabe, Arthur B. Proceedings of the 3rd International Workshop on Runtime and Operating Systems for Supercomputers - ROSS '13 https://doi.org/10.1145/2491661.2481427	conference	January 2013
Introducing OpenSHMEM: SHMEM for the PGAS community Chapman, Barbara; Curtis, Tony; Pophale, Swaroop Proceedings of the Fourth Conference on Partitioned Global Address Space Programming Model - PGAS '10 https://doi.org/10.1145/2020373.2020375	conference	January 2010
Co-array Fortran Performance and Potential: An NPB Experimental Study Coarfa, Cristian; Dotsenko, Yuri; Eckhardt, Jason Languages and Compilers for Parallel Computing https://doi.org/10.1007/978-3-540-24644-2_12	book	January 2004
MapReduce: simplified data processing on large clusters Dean, Jeffrey; Ghemawat, Sanjay; Mehta, Brijesh Communications of the ACM, Vol. 51, Issue 1 https://doi.org/10.1145/1327452.1327492	journal	January 2008
Riding the elephant: managing ensembles with hadoop Dede, Elif; Govindaraju, Madhusudhan; Gunter, Daniel Proceedings of the 2011 ACM international workshop on Many task computing on grids and supercomputers - MTAGS '11 https://doi.org/10.1145/2132876.2132888	conference	January 2011
FT-MPI: Fault Tolerant MPI, Supporting Dynamic Applications in a Dynamic World Fagg, Graham E.; Dongarra, Jack J. Recent Advances in Parallel Virtual Machine and Message Passing Interface https://doi.org/10.1007/3-540-45255-9_47	book	January 2000
The Impact of System Design Parameters on Application Noise Sensitivity Ferreira, Kurt B.; Bridges, Patrick G.; Brightwell, Ron 2010 IEEE International Conference on Cluster Computing (CLUSTER) https://doi.org/10.1109/CLUSTER.2010.41	conference	September 2010
Programming for Exascale Computers Gropp, William; Snir, Marc Computing in Science & Engineering, Vol. 15, Issue 6 https://doi.org/10.1109/MCSE.2013.96	journal	November 2013
Evaluation of HPC Applications on Cloud Gupta, Abhishek; Milojicic, Dejan 2011 6th Open Cirrus Summit (OCS), 2011 Sixth Open Cirrus Summit https://doi.org/10.1109/OCS.2011.10	conference	October 2011
Performance Evaluation of Open MPI on Cray XE/XK Systems Gutierrez, Samuel K.; Hjelm, Nathan T.; Venkata, Manjunath Gorentla 2012 IEEE 20th Annual Symposium on High-Performance Interconnects (HOTI) https://doi.org/10.1109/HOTI.2012.11	conference	August 2012
PGR: a software package for reconfigurable super-computing Hamada, T.; Nakasato, N. International Conference on Field Programmable Logic and Applications, 2005. https://doi.org/10.1109/FPL.2005.1515749	conference	January 2005
Implementing OpenSHMEM Using MPI-3 One-Sided Communication Hammond, Jeff R.; Ghosh, Sayan; Chapman, Barbara M. Lecture Notes in Computer Science https://doi.org/10.1007/978-3-319-05215-1_4	book	January 2014
Case study for running HPC applications in public clouds He, Qiming; Zhou, Shujia; Kobler, Ben Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing - HPDC '10 https://doi.org/10.1145/1851476.1851535	conference	January 2010
On the Use of Cloud Computing for Scientific Workflows Hoffa, Christina; Mehta, Gaurang; Freeman, Tim 2008 IEEE Fourth International Conference on eScience (eScience) https://doi.org/10.1109/eScience.2008.167	conference	December 2008
Performance Analysis of Cloud Computing Services for Many-Tasks Scientific Computing Iosup, A.; Ostermann, S.; Yigitbasi, M. N. IEEE Transactions on Parallel and Distributed Systems, Vol. 22, Issue 6 https://doi.org/10.1109/TPDS.2011.66	journal	June 2011
Global arrays: a portable "shared-memory" programming model for distributed memory computers Nieplocha, Jaroslaw; Harrison, Robert J.; Littlefield, Richard J. Proceedings of the 1994 ACM/IEEE conference on Supercomputing - Supercomputing '94 https://doi.org/10.1145/602770.602833	conference	January 1994
A uGNI-Based MPICH2 Nemesis Network Module for the Cray XE Pritchard, Howard; Gorodetsky, Igor; Buntinas, Darius Recent Advances in the Message Passing Interface https://doi.org/10.1007/978-3-642-24449-0_14	book	January 2011
The new features of Fortran 2008 Reid, John ACM SIGPLAN Fortran Forum, Vol. 27, Issue 2 https://doi.org/10.1145/1408643.1408645	journal	August 2008
The design and evolution of Zipcode Skjellum, Anthony; Smith, Steven G.; Doss, Nathan E. Parallel Computing, Vol. 20, Issue 4 https://doi.org/10.1016/0167-8191(94)90029-9	journal	April 1994
PVM: A framework for parallel distributed computing Sunderam, V. S. Concurrency: Practice and Experience, Vol. 2, Issue 4 https://doi.org/10.1002/cpe.4330020404	journal	December 1990
Exploring the All-to-All Collective Optimization Space with ConnectX CORE-Direct Venkata, Manjunath Gorentla; Graham, Richard L.; Ladd, Joshua 2012 41st International Conference on Parallel Processing (ICPP) https://doi.org/10.1109/ICPP.2012.28	conference	September 2012
Optimizing blocking and nonblocking reduction operations for multicore systems: Hierarchical design and implementation Venkata, Manjunath Gorentla; Shamis, Pavel; Sampath, Rahul 2013 IEEE International Conference on Cluster Computing (CLUSTER) https://doi.org/10.1109/CLUSTER.2013.6702676	conference	September 2013
An integrative variant analysis pipeline for accurate genotype/haplotype inference in population NGS data Wang, Y.; Lu, J.; Yu, J. Genome Research, Vol. 23, Issue 5 https://doi.org/10.1101/gr.146084.112	journal	January 2013

Similar Records

A Testbed of Parallel Kernels for Computer Science Research

Technical Report · Fri Apr 30 00:00:00 EDT 2010 · OSTI ID:1567681

Bailey, David; Demmel, James; Ibrahim, Khaled; +6 more

Global Arrays Parallel Programming Toolkit

Book · Sat Jan 01 00:00:00 EST 2011 · OSTI ID:1567681

Nieplocha, Jaroslaw; Krishnan, Manoj Kumar; Palmer, Bruce J.; +3 more

Concurrent Collections (CnC): A new approach to parallel programming

Multimedia · Fri May 07 00:00:00 EDT 2010 · OSTI ID:1567681

Knobe, Kathleen

Title: Parallel Programming Models and Systems for High Performance Computing. In: Emerging Research in Cloud Distributed Computing Systems

Citation Formats

References (26)

Similar Records

Related Subjects