Title: Automated data processing architecture for the Gemini Planet Imager Exoplanet Survey

Abstract

The Gemini Planet Imager Exoplanet Survey (GPIES) is a multiyear direct imaging survey of 600 stars to discover and characterize young Jovian exoplanets and their environments. We have developed an automated data architecture to process and index all data related to the survey uniformly. An automated and flexible data processing framework, which we term the Data Cruncher, combines multiple data reduction pipelines (DRPs) together to process all spectroscopic, polarimetric, and calibration data taken with GPIES. With no human intervention, fully reduced and calibrated data products are available less than an hour after the data are taken to expedite follow up on potential objects of interest. The Data Cruncher can run on a supercomputer to reprocess all GPIES data in a single day as improvements are made to our DRPs. A backend MySQL database indexes all files, which are synced to the cloud, and a front-end web server allows for easy browsing of all files associated with GPIES. To help observers, quicklook displays show reduced data as they are processed in real time, and chatbots on Slack post observing information as well as reduced data products. Together, the GPIES automated data processing architecture reduces our workload, provides real-time data reduction, optimizesmore » our observing strategy, and maintains a homogeneously reduced dataset to study planet occurrence and instrument performance.« less

Authors:

Wang, Jason J. ^[1]; Perrin, Marshall D. ^[2]; Savransky, Dmitry ^[3]; Arriaga, Pauline ^[4]; Chilcote, Jeffrey K. ^[5]; De Rosa, Robert J. ^[1]; Millar-Blanchaer, Maxwell A. ^[6]; Marois, Christian ^[7]; Rameau, Julien ^[8]; Wolff, Schuyler G. ^[2]; Shapiro, Jacob ^[3]; Ruffio, Jean-Baptiste ^[5]; Maire, Jérôme ^[9]; Marchis, Franck ^[10]

---

+ Show Author Affiliations

1. UC Berkeley, Department of Astronomy, Berkeley, California
2. Space Telescope Science Institute, Baltimore, Maryland
3. Cornell University, Sibley School of Mechanical and Aerospace Engineering, Ithaca, New York
4. UCLA, Department of Physics and Astronomy, Los Angeles, California
5. Stanford University, Kavli Institute for Particle Astrophysics and Cosmology, Stanford, California
6. Jet Propulsion Laboratory, California Institute of Technology, Pasadena, California
7. National Research Council of Canada Herzberg, Victoria, British Columbia
8. Université de Montréal, Institut de Recherche sur les Exoplanètes, Départment de Physique, Montréal,
9. University of California San Diego, Center for Astrophysics and Space Science, La Jolla, California
10. SETI Institute, Carl Sagan Center, Mountain View, California

Publication Date:

Thu Jan 18 00:00:00 EST 2018

Research Org.:

Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)

Sponsoring Org.:

USDOE National Nuclear Security Administration (NNSA); National Aeronautics and Space Administration (NASA); National Science Foundation (NSF)

Contributing Org.:

G. GPIES Survey

OSTI Identifier:

1836917

Report Number(s):

LLNL-JRNL-829573
Journal ID: ISSN 2329-4124; 1045532; TRN: US2300387

Grant/Contract Number:  

AC52-07NA27344; NNX15AD95G; AC02-05CH11231; ACI-1548562; 51378.01-A

Resource Type:

Accepted Manuscript

Journal Name:

Journal of Astronomical Telescopes, Instruments, and Systems

Additional Journal Information:

Journal Volume: 4; Journal Issue: 01; Journal ID: ISSN 2329-4124

Publisher:

SPIE

Country of Publication:

United States

Language:

English

Subject:

79 ASTRONOMY AND ASTROPHYSICS; high contrast imaging; exoplanets; circumstellar disks; data processing; Gemini Planet Imager; Data Cruncher