skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: The Hyper Suprime-Cam software pipeline

Journal Article · · Publications of the Astronomical Society of Japan
DOI:https://doi.org/10.1093/pasj/psx080· OSTI ID:1425668
 [1];  [1];  [2];  [3];  [3];  [3];  [1];  [3];  [1];  [4];  [3];  [5];  [1];  [6];  [7];  [8];  [9];  [10];  [6];  [11] more »;  [12];  [10];  [1];  [1];  [13];  [14];  [4];  [15];  [5];  [16];  [6];  [1];  [1];  [3];  [3] « less
  1. Princeton Univ., NJ (United States). Dept. of Astrophysical Sciences
  2. Orbital Insight, Mountain View, CA (United States); Univ. of Tokyo (Japan). Kavli Inst. for the Physics and Mathematics of the Universe (Kavli IPMU, WPI)
  3. National Astronomical Observatory of Japan, Mitaka, Tokyo (Japan)
  4. National Astronomical Observatory of Japan, Mitaka, Tokyo (Japan); Graduate Univ. for Advanced Studies (SOKENDAI), Mitaka, Tokyo (Japan). Dept. of Astronomy, School of Science
  5. Univ. of Tokyo (Japan). Kavli Inst. for the Physics and Mathematics of the Universe (Kavli IPMU, WPI)
  6. Univ. of Washington, Seattle, WA (United States). Dept. of Astronomy
  7. Princeton Univ., NJ (United States). Dept. of Physics
  8. Univ. of Geneva (Switzerland). Dept. of Astronomy
  9. Princeton Univ., NJ (United States). Dept. of Astrophysical Sciences; Massive Dynamics, Princeton, NJ (United States)
  10. SLAC National Accelerator Lab., Menlo Park, CA (United States)
  11. Univ. of Toronto, ON (Canada). Dunlap Inst. and Dept. of Astronomy and Astrophysics
  12. Univ. of Tokyo (Japan). Kavli Inst. for the Physics and Mathematics of the Universe (Kavli IPMU, WPI); Massive Dynamics, Princeton, NJ (United States)
  13. Carnegie Mellon Univ., Pittsburgh, PA (United States). McWilliams Center for Cosmology, Dept. of Physics
  14. Univ. of Tokyo (Japan). Kavli Inst. for the Physics and Mathematics of the Universe (Kavli IPMU, WPI); California Inst. of Technology (CalTech), Pasadena, CA (United States). Jet Propulsion Lab.
  15. Univ. of Tokyo (Japan). Kavli Inst. for the Physics and Mathematics of the Universe (Kavli IPMU, WPI); Univ. of Tokyo (Japan). Dept. of Physics
  16. Inst. of Physical and Chemical Research (RIKEN), Wako (Japan). High Energy Astrophysics Lab.; Brookhaven National Lab. (BNL), Upton, NY (United States). RIKEN Research Center

Here in this article, we describe the optical imaging data processing pipeline developed for the Subaru Telescope’s Hyper Suprime-Cam (HSC) instrument. The HSC Pipeline builds on the prototype pipeline being developed by the Large Synoptic Survey Telescope’s Data Management system, adding customizations for HSC, large-scale processing capabilities, and novel algorithms that have since been reincorporated into the LSST codebase. While designed primarily to reduce HSC Subaru Strategic Program (SSP) data, it is also the recommended pipeline for reducing general-observer HSC data. The HSC pipeline includes high-level processing steps that generate coadded images and science-ready catalogs as well as low-level detrending and image characterizations.

Research Organization:
SLAC National Accelerator Laboratory (SLAC), Menlo Park, CA (United States)
Sponsoring Organization:
USDOE; Japan Society for the Promotion of Science (JSPS); Japan Science and Technology Agency (JST)
Grant/Contract Number:
AC02-76SF00515; NNX08AR22G; AST-1238877; JP15K17600; JP16H01089
OSTI ID:
1425668
Journal Information:
Publications of the Astronomical Society of Japan, Vol. 70, Issue SP1; ISSN 0004-6264
Publisher:
Astronomical Society of JapanCopyright Statement
Country of Publication:
United States
Language:
English
Citation Metrics:
Cited by: 300 works
Citation information provided by
Web of Science

References (44)

The Dark Energy Survey: more than dark energy – an overview journal March 2016
How to COAAD Images. II. A Coaddition Image that is Optimal for Any Purpose in the Background-dominated Noise Limit journal February 2017
Replacing Standard Galaxy Profiles with Mixtures of Gaussians journal June 2013
Hyper Suprime-Cam: System design and verification of image quality journal September 2017
THE SLOAN DIGITAL SKY SURVEY COADD: 275 deg 2 OF DEEP SLOAN DIGITAL SKY SURVEY IMAGING ON STRIPE 82 journal September 2014
SExtractor: Software for source extraction journal June 1996
GalSim: The modular galaxy image simulation toolkit journal April 2015
The brighter-fatter effect and pixel correlations in CCD sensors journal March 2014
Photometry of a complete sample of faint galaxies journal June 1980
Toward Precision LSST Weak-Lensing Measurement. I. Impacts of Atmospheric Turbulence and Optical Aberration journal May 2011
The bright-star masks for the HSC-SSP survey journal July 2017
Hyper Suprime-Cam: Camera dewar design journal September 2017
Photometric redshifts for Hyper Suprime-Cam Subaru Strategic Program Data Release 1 journal October 2017
Weak Gravitational Lensing with COSMOS: Galaxy Selection and Shape Measurements
  • Leauthaud, Alexie; Massey, Richard; Kneib, Jean‐Paul
  • The Astrophysical Journal Supplement Series, Vol. 172, Issue 1 https://doi.org/10.1086/516598
journal September 2007
The DES Science Verification weak lensing shear catalogues journal May 2016
An algorithm for precise aperture photometry of critically sampled images journal March 2013
Astrometric Calibration of the Sloan Digital Sky Survey journal March 2003
Fast Algorithms for Matching CCD Images to a Stellar Catalogue journal January 2007
Bayesian galaxy shape measurement for weak lensing surveys – III. Application to the Canada–France–Hawaii Telescope Lensing Survey journal January 2013
Weak Gravitational Lensing and Its Cosmological Applications journal November 2008
Gravitational lensing analysis of the Kilo-Degree Survey journal October 2015
The Kilo-Degree Survey journal August 2012
Impact of Atmospheric Chromatic Effects on weak Lensing Measurements journal July 2015
Shear calibration biases in weak-lensing surveys journal August 2003
An implementation of Bayesian lensing shear measurement journal July 2014
Galaxy Modeling with Compound Elliptical Shapelets journal August 2010
DAOPHOT - A computer program for crowded-field stellar photometry journal March 1987
The Second Data Release of the Sloan Digital Sky Survey journal July 2004
The on-site quality-assurance system for Hyper Suprime-Cam: OSQAH† journal September 2017
Characterization and photometric performance of the Hyper Suprime-Cam Software Pipeline journal December 2017
The first-year shear catalog of the Subaru Hyper Suprime-Cam Subaru Strategic Program Survey journal December 2017
GALSIM: The modular galaxy image simulation toolkit text January 2015
GALSIM: The modular galaxy image simulation toolkit text January 2015
Fast algorithms for matching CCD images to a stellar catalogue text January 2007
Weak Gravitational Lensing and its Cosmological Applications text January 2008
Bayesian Galaxy Shape Measurement for Weak Lensing Surveys - III. Application to the Canada-France-Hawaii Telescope Lensing Survey text January 2012
An Algorithm for Precise Aperture Photometry of Critically Sampled Images text January 2013
The brighter-fatter effect and pixel correlations in CCD sensors text January 2014
Impact of Atmospheric Chromatic Effects on Weak Lensing Measurements text January 2014
Characterization and correction of charge-induced pixel shifts in DECam text January 2015
The DES Science Verification Weak Lensing Shear Catalogues text January 2015
The Dark Energy Survey: more than dark energy - an overview text January 2016
Characterization and Photometric Performance of the Hyper Suprime-Cam Software Pipeline text January 2017
The Second Data Release of the Sloan Digital Sky Survey text January 2004

Cited By (92)

Microlensing constraints on primordial black holes with Subaru/HSC Andromeda observations journal April 2019
Galaxy formation and evolution science in the era of the Large Synoptic Survey Telescope journal June 2019
IC 4665 DANCe: I. Members, empirical isochrones, magnitude distributions, present-day system mass function, and spatial distribution⋆ journal October 2019
Survey of gravitationally-lensed objects in HSC imaging (SuGOHI): III. Statistical strong lensing constraints on the stellar IMF of CMASS galaxies journal September 2019
MAXIMASK and MAXITRACK: Two new tools for identifying contaminants in astronomical images using convolutional neural networks journal February 2020
Estimating Sky Level journal July 2018
Imaging extended emission-line regions of obscured AGN with the Subaru Hyper Suprime-Cam Survey journal May 2018
Weak lensing shear calibration with simulations of the HSC survey journal September 2018
Fourier Power Function Shapelets (FPFS) shear estimator: performance on image simulations journal October 2018
The stellar halo of isolated central galaxies in the Hyper Suprime-Cam imaging survey journal May 2019
Galaxy–Galaxy lensing in HSC: Validation tests and the impact of heterogeneous spectroscopic training sets journal October 2019
Measurement of redshift-dependent cross-correlation of HSC clusters and Fermi γ-rays journal February 2019
Weak lensing reveals a tight connection between dark matter halo mass and the distribution of stellar mass in massive galaxies journal December 2019
The Hyper Suprime-Cam SSP Survey: Overview and survey design journal September 2017
Great Optically Luminous Dropout Research Using Subaru HSC (GOLDRUSH). I. UV luminosity functions at z ∼ 4–7 derived with the half-million dropouts on the 100 deg2 sky† journal November 2017
SILVERRUSH. III. Deep optical and near-infrared spectroscopy for Lyα and UV-nebular lines of bright Lyα emitters at z = 6–7†‡ journal November 2017
Characterization and photometric performance of the Hyper Suprime-Cam Software Pipeline journal December 2017
Subaru Hyper Suprime-Cam Survey for an optical counterpart of GW170817‡ journal February 2018
Optical follow-up observation of Fast Radio Burst 151230 journal October 2018
Cosmology from cosmic shear power spectra with Subaru Hyper Suprime-Cam first-year data journal March 2019
Searches for Population III pair-instability supernovae: Impact of gravitational lensing magnification journal April 2019
The Hyper Suprime-Cam SSP transient survey in COSMOS: Overview journal May 2019
Halo concentration, galaxy red fraction, and gas properties of optically defined merging clusters† journal July 2019
The mass–richness relation of optically selected clusters from weak gravitational lensing and abundance with Subaru HSC first-year data journal September 2019
The whole picture of the large-scale structure of the CL1604 supercluster at z ∼ 0.9 journal September 2019
Second data release of the Hyper Suprime-Cam Subaru Strategic Program journal October 2019
X-ray properties of high-richness CAMIRA clusters in the Hyper Suprime-Cam Subaru Strategic Program field journal November 2019
Cosmological constraints from cosmic shear two-point correlation functions with HSC survey first-year data journal February 2020
Fast Algorithms for Slow Moving Asteroids: Constraints on the Distribution of Kuiper Belt Objects journal February 2019
Stellar Stream and Halo Structure in the Andromeda Galaxy from a Subaru/Hyper Suprime-Cam Survey journal January 2018
Illuminating Low Surface Brightness Galaxies with the Hyper Suprime-Cam Survey journal April 2018
SILVERRUSH. V. Census of Ly α , [O iii] λ 5007, H α , and [C ii] 158 μ m Line Emission with ∼1000 LAEs at z = 4.9–7.0 Revealed with Subaru/HSC journal May 2018
Evidence for Large-scale Fluctuations in the Metagalactic Ionizing Background Near Redshift Six journal August 2018
A Lonely Giant: The Sparse Satellite Population of M94 Challenges Galaxy Formation journal August 2018
CHORUS. II. Subaru/HSC Determination of the Ly α Luminosity Function at z = 7.0: Constraints on Cosmic Reionization Model Parameter journal October 2018
Tidal Features at 0.05 < z < 0.45 in the Hyper Suprime-Cam Subaru Strategic Program: Properties and Formation Channels journal October 2018
A Study of Two Diffuse Dwarf Galaxies in the Field journal October 2018
A Wide and Deep Exploration of Radio Galaxies with Subaru HSC (WERGS). I. The Optical Counterparts of FIRST Radio Sources journal October 2018
Survey of Gravitationally Lensed Objects in HSC Imaging (SuGOHI). II. Environments and Line-of-Sight Structure of Strong Gravitational Lens Galaxies to z ∼ 0.8 journal November 2018
Subaru High- z Exploration of Low-luminosity Quasars (SHELLQs). V. Quasar Luminosity Function and Contribution to Cosmic Reionization at z = 6 journal December 2018
A Census of Galaxy Constituents in a Coma Progenitor Observed at z > 3 journal January 2019
Quiescent Galaxy Size and Spectroscopic Evolution: Combining HSC Imaging and Hectospec Spectroscopy journal February 2019
LSST: From Science Drivers to Reference Design and Anticipated Data Products journal March 2019
Weak-lensing Mass Calibration of ACTPol Sunyaev–Zel’dovich Clusters with the Hyper Suprime-Cam Survey journal April 2019
The Evolution of the Quenching of Star Formation in Cluster Galaxies since z ∼ 1 journal May 2019
Optical Properties of Infrared-bright Dust-obscured Galaxies Viewed with Subaru Hyper Suprime-Cam journal May 2019
The Brightest UV-selected Galaxies in Protoclusters at z ∼ 4: Ancestors of Brightest Cluster Galaxies? journal June 2019
Hyper Wide Field Imaging of the Local Group Dwarf Irregular Galaxy IC 1613: An Extended Component of Metal-poor Stars journal July 2019
The Rest-frame H -band Luminosity Function of Red-sequence Galaxies in Clusters at 1.0 < z < 1.3 journal August 2019
HSC16aayt: A Slowly Evolving Interacting Transient Rising for More than 100 Days journal September 2019
Evidence for the Cross-correlation between Cosmic Microwave Background Polarization Lensing from Polarbear and Cosmic Shear from Subaru Hyper Suprime-Cam journal September 2019
Subaru High- z Exploration of Low-luminosity Quasars (SHELLQs). X. Discovery of 35 Quasars and Luminous Galaxies at 5.7 ≤ z ≤ 7.0 journal October 2019
A Rapidly Declining Transient Discovered with the Subaru/Hyper Suprime-Cam journal October 2019
Stellar Population and Structural Properties of Dwarf Galaxies and Young Stellar Systems in the M81 Group journal October 2019
Tidal Destruction in a Low-mass Galaxy Environment: The Discovery of Tidal Tails around DDO 44 journal November 2019
Evidence for a Highly Opaque Large-scale Galaxy Void at the End of Reionization journal December 2019
Subaru High- z Exploration of Low-luminosity Quasars (SHELLQs). IV. Discovery of 41 Quasars and Luminous Galaxies at 5.7 ≤ z ≤ 6.9 journal July 2018
First Release of High-Redshift Superluminous Supernovae from the Subaru HIgh- Z SUpernova CAmpaign (SHIZUCA). I. Photometric Properties journal March 2019
A Wide and Deep Exploration of Radio Galaxies with Subaru HSC (WERGS). II. Physical Properties Derived from the SED Fitting with Optical, Infrared, and Radio Data journal July 2019
OSSOS. XII. Variability Studies of 65 Trans-Neptunian Objects Using the Hyper Suprime-Cam journal September 2019
Stellar Velocity Dispersion of a Massive Quenching Galaxy at z = 4.01 journal November 2019
Deep Hyper Suprime-Cam Images and a Forced Photometry Catalog in W-CDF-S journal January 2019
Optical properties of infrared-bright dust-obscured galaxies viewed with Subaru Hyper Suprime-Cam journal November 2019
LSST: from Science Drivers to Reference Design and Anticipated Data Products text January 2008
Characterization and Photometric Performance of the Hyper Suprime-Cam Software Pipeline text January 2017
Subaru Hyper Suprime-Cam Survey for An Optical Counterpart of GW170817 text January 2017
Stellar Stream and Halo Structure in the Andromeda Galaxy From a Subaru/Hyper Suprime-Cam Survey text January 2017
Optical properties of infrared-bright dust-obscured galaxies viewed with Subaru Hyper Suprime-Cam text January 2018
A Study of Two Diffuse Dwarf Galaxies in the Field text January 2018
Survey of Gravitationally-lensed Objects in HSC Imaging (SuGOHI). II. Environments and Line-of-Sight Structure of Strong Gravitational Lens Galaxies to z ~ 0.8 text January 2018
Cosmology from cosmic shear power spectra with Subaru Hyper Suprime-Cam first-year data text January 2018
Quiescent Galaxy Size and Spectroscopic Evolution: Combining HSC Imaging and Hectospec Spectroscopy text January 2018
Subaru High-z Exploration of Low-Luminosity Quasars (SHELLQs). V. Quasar Luminosity Function and Contribution to Cosmic Reionization at z = 6 text January 2018
The stellar halo of isolated central galaxies in the Hyper Suprime-Cam imaging survey text January 2018
OSSOS XII: Variability studies of 65 Trans-Neptunian Objects using the Hyper Suprime-Cam text January 2018
Halo Concentration, Galaxy Red Fraction, and Gas Properties of Optically-defined Merging Clusters text January 2018
Deep Hyper Suprime-Cam Images and a Forced Photometry Catalog in W-CDF-S preprint January 2018
Fast algorithms for slow moving asteroids: constraints on the distribution of Kuiper Belt Objects text January 2019
Searches for Population III Pair-Instability Supernovae: Impact of Gravitational Lensing Magnification text January 2019
The brightest UV-selected galaxies in protoclusters at $z\sim4$: Ancestors of Brightest Cluster Galaxies? text January 2019
The mass-richness relation of optically-selected clusters from weak gravitational lensing and abundance with Subaru HSC first-year data text January 2019
The Hyper Suprime-Cam SSP Transient Survey in COSMOS: Overview text January 2019
Survey of gravitationally-lensed objects in HSC imaging (SuGOHI). III. Statistical strong lensing constraints on the stellar IMF of CMASS galaxies text January 2019
A Wide and Deep Exploration of Radio Galaxies with Subaru HSC (WERGS). II. Physical Properties derived from the SED Fitting with Optical, Infrared, and Radio Data text January 2019
Hyper Wide Field Imaging of the Local Group Dwarf Irregular Galaxy IC 1613: An Extended Component of Metal-poor Stars text January 2019
Second Data Release of the Hyper Suprime-Cam Subaru Strategic Program text January 2019
The whole picture of the large-scale structure of the CL1604 supercluster at z$\sim$0.9 text January 2019
Galaxy-Galaxy Lensing in HSC: Validation Tests and the Impact of Heterogeneous Spectroscopic Training Sets text January 2019
HSC16aayt: Slowly evolving interacting transient rising for more than 100 days text January 2019
A rapidly declining transient discovered with Subaru/Hyper Suprime-Cam text January 2019
Evidence for a highly opaque large-scale galaxy void at the end of reionization text January 2019
Stellar Velocity Dispersion of a Massive Quenching Galaxy at z=4.01 text January 2019

Similar Records

Second data release of the Hyper Suprime-Cam Subaru Strategic Program
Journal Article · Tue Oct 22 00:00:00 EDT 2019 · Publications of the Astronomical Society of Japan · OSTI ID:1425668

Third data release of the Hyper Suprime-Cam Subaru Strategic Program
Journal Article · Mon Feb 14 00:00:00 EST 2022 · Publications of the Astronomical Society of Japan · OSTI ID:1425668

Hyper Suprime-Cam Year 3 results: Cosmology from cosmic shear power spectra
Journal Article · Mon Dec 11 00:00:00 EST 2023 · Physical Review. D. · OSTI ID:1425668