Performance Characterization of De Novo Genome Assembly on Leading Parallel Systems.
Conference
·
· Lecture Notes in Computer Science, vol 10417. Springer, Cham
- Computational Research Division, Lawrence Berkeley National Laboratory, Berkeley, CA
- Joint Genome Institute, Lawrence Berkeley National Laboratory, Berkeley, CA
- National Energy Research Scientific Computing Center, Berkeley, CA
De novo genome assembly is one of the most important and challenging computational problems in modern genomics; further, it shares algorithms and communication patterns important to other graph analytic and irregular applications. Unlike simulations, it has no floating point arithmetic and is dominated by small memory transactions within and between computing nodes. In this work, we focus on the highly scalable HipMer assembler and identify the dominant algorithms and communication patterns, also using microbenchmarks to capture the workload. We evaluate HipMer on a variety of platforms from the latest HPC systems to ethernet clusters. HipMer performs well on all single node systems, including the Xeon Phi manycore architecture. Given large enough problems, it also demonstrates excellent scaling across nodes in an HPC system, but requires a high speed network with low overhead and high injection rates. Our results shed light on the architectural features that are most important for achieving good parallel efficiency on this and related problems.
- Research Organization:
- Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF); None; Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)
- Sponsoring Organization:
- USDOE Office of Science; USDOE
- OSTI ID:
- 1567514
- Conference Information:
- Journal Name: Lecture Notes in Computer Science, vol 10417. Springer, Cham
- Country of Publication:
- United States
- Language:
- English
Similar Records
Extreme-Scale De Novo Genome Assembly
A Locality-Based Threading Algorithm for the Configuration-Interaction Method
Enabling Diverse Software Stacks on Supercomputers using High Performance Virtual Clusters.
Journal Article
·
Mon Sep 25 20:00:00 EDT 2017
·
OSTI ID:1398520
A Locality-Based Threading Algorithm for the Configuration-Interaction Method
Journal Article
·
Sun Jul 02 20:00:00 EDT 2017
· IEEE International Symposium on Parallel and Distributed Processing, Workshops and Phd Forum
·
OSTI ID:1393243
Enabling Diverse Software Stacks on Supercomputers using High Performance Virtual Clusters.
Technical Report
·
Mon May 01 00:00:00 EDT 2017
·
OSTI ID:1367280