Quartile and Outlier Detection on Heterogeneous Clusters Using Distributed Radix Sort.

Conference · Sat Jan 01 00:00:00 EST 2011

DOI:https://doi.org/10.1109/CLUSTER.2011.53· OSTI ID:1042840

Spafford, Kyle L ^[1]; Meredith, Jeremy S ^[1]; Vetter, Jeffrey S ^[1]

---

1. ORNL

In the past few years, performance improvements in CPUs and memory technologies have outpaced those of storage systems. When extrapolated to the exascale, this trend places strict limits on the amount of data that can be written to disk for full analysis, resulting in an increased reliance on characterizing in-memory data. Many of these characterizations are simple, but require sorted data. This paper explores an example of this type of characterization - the identification of quartiles and statistical outliers - and presents a performance analysis of a distributed heterogeneous radix sort as well as an assessment of current architectural bottlenecks.

• Research Organization: Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
• Sponsoring Organization: USDOE Office of Science (SC)
• DOE Contract Number: AC05-00OR22725
• OSTI ID: 1042840
• Resource Relation: Conference: IEEE Workshop on Parallel Programming on Accelerator Clusters (PPAC), Austin, TX, USA, 20110926, 20110930
• Country of Publication: United States
• Language: English