Architectural Implications for Spatial Object Association Algorithms
Spatial object association, also referred to as cross-match of spatial datasets, is the problem of identifying and comparing objects in two or more datasets based on their positions in a common spatial coordinate system. In this work, we evaluate two crossmatch algorithms that are used for astronomical sky surveys, on the following database system architecture configurations: (1) Netezza Performance Server R, a parallel database system with active disk style processing capabilities, (2) MySQL Cluster, a high-throughput network database system, and (3) a hybrid configuration consisting of a collection of independent database system instances with data replication support. Our evaluation provides insights about how architectural characteristics of these systems affect the performance of the spatial crossmatch algorithms. We conducted our study using real use-case scenarios borrowed from a large-scale astronomy application known as the Large Synoptic Survey Telescope (LSST).
- Research Organization:
- Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
- Sponsoring Organization:
- USDOE
- DOE Contract Number:
- W-7405-ENG-48
- OSTI ID:
- 956855
- Report Number(s):
- LLNL-CONF-410283; TRN: US201007%%89
- Resource Relation:
- Conference: Presented at: IEEE International Parallel & Distributed Processing Symposium, Rome, Italy, May 25 - May 29, 2009
- Country of Publication:
- United States
- Language:
- English
Similar Records
The Large Synoptic Survey Telescope and Foundations for Data Exploitation of Petabyte Data Sets
Automated data processing architecture for the Gemini Planet Imager Exoplanet Survey