Processing Full-Scale Square Kilometre Array Data on the Summit Supercomputer

Conference · Sun Nov 01 00:00:00 EDT 2020

DOI:https://doi.org/10.1109/SC41405.2020.00006· OSTI ID:1772857

Wang, Ruonan ^[1]; Tobar, Rodrigo ^[2]; Dolensky, Markus ^[2]; An, Tao ^[3]; Wicenec, Andreas ^[2]; Wu, Chen ^[2]; Dulwich, Fred ^[4]; Podhorszki, Norbert  ^[1]; Anantharaj, Valentine  ^[1]; Suchyta, Eric  ^[1]; Lao, Baoqiang ^[5]; Klasky, Scott  ^[1]

---

1. ORNL
2. The University of Western Australia
3. Shanghai Radio Astronomical Observatory
4. University of Oxford, UK
5. Shanghai Astronomical Observatory

This work presents a workflow for simulating and processing the full-scale low-frequency telescope data of the Square Kilometre Array (SKA) Phase 1. The SKA project will enter the construction phase soon, and once completed, it will be the world’s largest radio telescope and one of the world’s largest data generators. The authors used Summit to mimic an endto-end SKA workflow, simulating a dataset of a typical 6 hour observation and then processing that dataset with an imaging pipeline. This workflow was deployed and run on 4,560 compute nodes, and used 27,360 GPUs to generate 2.6 PB of data. This was the first time that radio astronomical data were processed at this scale. Results show that the workflow has the capability to process one of the key SKA science cases, an Epoch of Reionization observation. This analysis also helps reveal critical design factors for the next-generation radio telescopes and the required dedicated processing facilities.

• Research Organization: Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
• Sponsoring Organization: USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
• DOE Contract Number: AC05-00OR22725
• OSTI ID: 1772857
• Resource Relation: Conference: SC20: International Conference for High Performance Computing, Networking, Storage and Analysis - Atlanta, Georgia, United States of America - 11/16/2020 5:00:00 AM-3/19/2021 4:00:00 AM
• Country of Publication: United States
• Language: English