DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Trend filtering – II. Denoising astronomical signals with varying degrees of smoothness

Journal Article · · Monthly Notices of the Royal Astronomical Society
ORCiD logo [1];  [2];  [3];  [1]
  1. Department of Statistics and Data Science, Carnegie Mellon University, Pittsburgh, PA 15213, USA, Machine Learning Department, Carnegie Mellon University, Pittsburgh, PA 15213, USA, McWilliams Center for Cosmology, Carnegie Mellon University, Pittsburgh, PA 15213, USA
  2. Department of Statistics and Data Science, Yale University, New Haven, CT 06520, USA
  3. McWilliams Center for Cosmology, Carnegie Mellon University, Pittsburgh, PA 15213, USA, Department of Physics, Carnegie Mellon University, Pittsburgh, PA 15213, USA, School of Physics, University of Melbourne, VIC 3010, Australia

ABSTRACT Trend filtering – first introduced into the astronomical literature in Paper I of this series – is a state-of-the-art statistical tool for denoising 1D signals that possess varying degrees of smoothness. In this work, we demonstrate the broad utility of trend filtering to observational astronomy by discussing how it can contribute to a variety of spectroscopic and time-domain studies. The observations we discuss are (1) the Lyman-α (Lyα) forest of quasar spectra; (2) more general spectroscopy of quasars, galaxies, and stars; (3) stellar light curves with planetary transits; (4) eclipsing binary light curves; and (5) supernova light curves. We study the Lyα forest in the greatest detail – using trend filtering to map the large-scale structure of the intergalactic medium along quasar-observer lines of sight. The remaining studies share broad themes of: (1) estimating observable parameters of light curves and spectra; and (2) constructing observational spectral/light-curve templates. We also briefly discuss the utility of trend filtering as a tool for 1D data reduction and compression.

Sponsoring Organization:
USDOE
OSTI ID:
1595847
Journal Information:
Monthly Notices of the Royal Astronomical Society, Journal Name: Monthly Notices of the Royal Astronomical Society Vol. 492 Journal Issue: 3; ISSN 0035-8711
Publisher:
Oxford University PressCopyright Statement
Country of Publication:
United Kingdom
Language:
English
Citation Metrics:
Cited by: 4 works
Citation information provided by
Web of Science

References (53)

A refined measurement of the mean transmitted flux in the Lyα forest over 2 < z < 5 using composite quasar spectra journal February 2013
THE CARNEGIE SUPERNOVA PROJECT: FIRST PHOTOMETRY DATA RELEASE OF LOW-REDSHIFT TYPE Ia SUPERNOVAE journal January 2010
Probing the Universe with the Ly  forest -- I. Hydrodynamics of the low-density intergalactic medium journal May 1998
On Estimating Regression journal January 1964
Type Ia Supernova Light Curves journal June 2007
Non-Parametric Estimation of a Multivariate Probability Density journal January 1969
The NASA Exoplanet Archive: Data and Tools for Exoplanet Research journal August 2013
THE COMPOSITE SPECTRUM OF STRONG Lyα FOREST ABSORBERS journal November 2010
Intergalactic Helium Absorption in Cold Dark Matter Models journal October 1997
A Feature at [CLC][ITAL]z[/ITAL][/CLC] ∼ 3.2 in the Evolution of the L[CLC]y[/CLC]α Forest Optical Depth journal January 2003
Mock Quasar-Lyman-α forest data-sets for the SDSS-III Baryon Oscillation Spectroscopic Survey journal May 2015
Fast and Flexible ADMM Algorithms for Trend Filtering journal July 2016
THE CARNEGIE SUPERNOVA PROJECT: INTRINSIC COLORS OF TYPE Ia SUPERNOVAE journal June 2014
Comparative Analysis of the High- and Low-Ionization Lines in the Broad-Line Region of Active Galactic Nuclei journal May 1996
The Linear Theory Power Spectrum from the Lyα Forest in the Sloan Digital Sky Survey journal December 2005
Evolution of the Intergalactic Opacity: Implications for the Ionizing Background, Cosmic Star Formation, and Quasar Activity journal November 2008
The absolute magnitudes of Type IA supernovae journal August 1993
Spectral Classification and Redshift Measurement for the Sdss-Iii Baryon Oscillation Spectroscopic Survey journal October 2012
The Eleventh and Twelfth data Releases of the Sloan Digital sky Survey: Final data from Sdss-Iii journal July 2015
The solution path of the generalized lasso journal June 2011
OVERVIEW OF THE KEPLER SCIENCE PROCESSING PIPELINE journal March 2010
Analytic Light Curves for Planetary Transit Searches journal December 2002
The Observability of Metal Lines Associated with the Lyα Forest journal May 1998
Kepler Eclipsing Binary Stars. iii. Classification of Kepler Eclipsing Binary Light Curves with Locally Linear Embedding journal April 2012
An Open Catalog for Supernova Data journal January 2017
The relationship between infrared, optical, and ultraviolet extinction journal October 1989
The one-dimensional Ly α forest power spectrum from BOSS journal November 2013
Robust Locally Weighted Regression and Smoothing Scatterplots journal December 1979
Kepler Planet-Detection Mission: Introduction and First Results journal January 2010
The man Behind the Curtain: X-Rays Drive the uv Through nir Variability in the 2013 Active Galactic Nucleus Outburst in ngc 2617 journal May 2014
Adaptive piecewise polynomial estimation via trend filtering journal February 2014
Sdss-Iii: Massive Spectroscopic Surveys of the Distant Universe, the Milky way, and Extra-Solar Planetary Systems journal August 2011
KEPLER 'S FIRST ROCKY PLANET: KEPLER-10b journal February 2011
LYα FOREST TOMOGRAPHY FROM BACKGROUND GALAXIES: THE FIRST MEGAPARSEC-RESOLUTION LARGE-SCALE STRUCTURE MAP AT z > 2 journal October 2014
The Eighth data Release of the Sloan Digital sky Survey: First data from Sdss-Iii journal March 2011
SN 2016coi (ASASSN-16fp): An Energetic H-stripped Core-collapse Supernova from a Massive Stellar Progenitor with Large Mass Loss journal September 2019
SN 2016coi/ASASSN-16fp: an example of residual helium in a typeIc supernova? journal May 2018
Light-curve classification in massive variability surveys - II. Transients towards the Large Magellanic Cloud journal July 2004
Toward a Precise Measurement of Matter Clustering: Lyα Forest Data at Redshifts 2–4 journal December 2002
ASASSN-16fp (SN 2016coi): a transitional supernova between Type Ic and broad-lined Ic journal September 2017
THE CARNEGIE SUPERNOVA PROJECT: LIGHT-CURVE FITTING WITH SNooPy journal December 2010
Measuring Reddening with Sloan Digital sky Survey Stellar Spectra and Recalibrating sfd journal August 2011
KEPLER ECLIPSING BINARY STARS. II. 2165 ECLIPSING BINARIES IN THE SECOND DATA RELEASE journal October 2011
Neutrino masses and cosmology with Lyman-alpha forest power spectrum journal November 2015
The power spectrum of the flux distribution in the Lyman   forest of a large sample of UVES QSO absorption spectra (LUQAS) journal January 2004
KEPLER ECLIPSING BINARY STARS. I. CATALOG AND PRINCIPAL CHARACTERIZATION OF 1879 ECLIPSING BINARIES IN THE FIRST DATA RELEASE journal February 2011
SOUSA: the Swift Optical/Ultraviolet Supernova Archive journal July 2014
KEPLER-10 c: A 2.2 EARTH RADIUS TRANSITING PLANET IN A MULTIPLE SYSTEM journal October 2011
A principal component analysis of quasar UV spectra at z  ~  3 journal May 2011
Pressure support versus thermal broadening in the Lyman α forest - I. Effects of the equation of state on longitudinal structure journal March 2010
Artificial Intelligence Approach to the Determination of Physical Properties of Eclipsing Binaries. I. The EBAI Project journal November 2008
The Lyman Alpha Forest in the Spectra of Quasistellar Objects journal September 1998
A wavelet analysis of the spectra of quasi-stellar objects journal October 2000

Similar Records

Related Subjects