skip to main content
DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Trend filtering – II. Denoising astronomical signals with varying degrees of smoothness

Abstract

ABSTRACT Trend filtering – first introduced into the astronomical literature in Paper I of this series – is a state-of-the-art statistical tool for denoising 1D signals that possess varying degrees of smoothness. In this work, we demonstrate the broad utility of trend filtering to observational astronomy by discussing how it can contribute to a variety of spectroscopic and time-domain studies. The observations we discuss are (1) the Lyman-α (Lyα) forest of quasar spectra; (2) more general spectroscopy of quasars, galaxies, and stars; (3) stellar light curves with planetary transits; (4) eclipsing binary light curves; and (5) supernova light curves. We study the Lyα forest in the greatest detail – using trend filtering to map the large-scale structure of the intergalactic medium along quasar-observer lines of sight. The remaining studies share broad themes of: (1) estimating observable parameters of light curves and spectra; and (2) constructing observational spectral/light-curve templates. We also briefly discuss the utility of trend filtering as a tool for 1D data reduction and compression.

Authors:
ORCiD logo [1];  [2];  [3];  [1]
  1. Department of Statistics and Data Science, Carnegie Mellon University, Pittsburgh, PA 15213, USA, Machine Learning Department, Carnegie Mellon University, Pittsburgh, PA 15213, USA, McWilliams Center for Cosmology, Carnegie Mellon University, Pittsburgh, PA 15213, USA
  2. Department of Statistics and Data Science, Yale University, New Haven, CT 06520, USA
  3. McWilliams Center for Cosmology, Carnegie Mellon University, Pittsburgh, PA 15213, USA, Department of Physics, Carnegie Mellon University, Pittsburgh, PA 15213, USA, School of Physics, University of Melbourne, VIC 3010, Australia
Publication Date:
Sponsoring Org.:
USDOE
OSTI Identifier:
1595847
Resource Type:
Published Article
Journal Name:
Monthly Notices of the Royal Astronomical Society
Additional Journal Information:
Journal Name: Monthly Notices of the Royal Astronomical Society Journal Volume: 492 Journal Issue: 3; Journal ID: ISSN 0035-8711
Publisher:
Oxford University Press
Country of Publication:
United Kingdom
Language:
English

Citation Formats

Politsch, Collin A., Cisewski-Kehe, Jessi, Croft, Rupert A. C., and Wasserman, Larry. Trend filtering – II. Denoising astronomical signals with varying degrees of smoothness. United Kingdom: N. p., 2020. Web. doi:10.1093/mnras/staa110.
Politsch, Collin A., Cisewski-Kehe, Jessi, Croft, Rupert A. C., & Wasserman, Larry. Trend filtering – II. Denoising astronomical signals with varying degrees of smoothness. United Kingdom. doi:10.1093/mnras/staa110.
Politsch, Collin A., Cisewski-Kehe, Jessi, Croft, Rupert A. C., and Wasserman, Larry. Tue . "Trend filtering – II. Denoising astronomical signals with varying degrees of smoothness". United Kingdom. doi:10.1093/mnras/staa110.
@article{osti_1595847,
title = {Trend filtering – II. Denoising astronomical signals with varying degrees of smoothness},
author = {Politsch, Collin A. and Cisewski-Kehe, Jessi and Croft, Rupert A. C. and Wasserman, Larry},
abstractNote = {ABSTRACT Trend filtering – first introduced into the astronomical literature in Paper I of this series – is a state-of-the-art statistical tool for denoising 1D signals that possess varying degrees of smoothness. In this work, we demonstrate the broad utility of trend filtering to observational astronomy by discussing how it can contribute to a variety of spectroscopic and time-domain studies. The observations we discuss are (1) the Lyman-α (Lyα) forest of quasar spectra; (2) more general spectroscopy of quasars, galaxies, and stars; (3) stellar light curves with planetary transits; (4) eclipsing binary light curves; and (5) supernova light curves. We study the Lyα forest in the greatest detail – using trend filtering to map the large-scale structure of the intergalactic medium along quasar-observer lines of sight. The remaining studies share broad themes of: (1) estimating observable parameters of light curves and spectra; and (2) constructing observational spectral/light-curve templates. We also briefly discuss the utility of trend filtering as a tool for 1D data reduction and compression.},
doi = {10.1093/mnras/staa110},
journal = {Monthly Notices of the Royal Astronomical Society},
number = 3,
volume = 492,
place = {United Kingdom},
year = {2020},
month = {1}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record
DOI: 10.1093/mnras/staa110

Save / Share:

Works referenced in this record:

A refined measurement of the mean transmitted flux in the Lyα forest over 2 < z < 5 using composite quasar spectra
journal, February 2013

  • Becker, George D.; Hewett, Paul C.; Worseck, Gábor
  • Monthly Notices of the Royal Astronomical Society, Vol. 430, Issue 3
  • DOI: 10.1093/mnras/stt031

THE CARNEGIE SUPERNOVA PROJECT: FIRST PHOTOMETRY DATA RELEASE OF LOW-REDSHIFT TYPE Ia SUPERNOVAE
journal, January 2010


Probing the Universe with the Ly  forest -- I. Hydrodynamics of the low-density intergalactic medium
journal, May 1998


On Estimating Regression
journal, January 1964

  • Nadaraya, E. A.
  • Theory of Probability & Its Applications, Vol. 9, Issue 1
  • DOI: 10.1137/1109020

Type Ia Supernova Light Curves
journal, June 2007

  • Woosley, S. E.; Kasen, D.; Blinnikov, S.
  • The Astrophysical Journal, Vol. 662, Issue 1
  • DOI: 10.1086/513732

Non-Parametric Estimation of a Multivariate Probability Density
journal, January 1969

  • Epanechnikov, V. A.
  • Theory of Probability & Its Applications, Vol. 14, Issue 1
  • DOI: 10.1137/1114019

The NASA Exoplanet Archive: Data and Tools for Exoplanet Research
journal, August 2013

  • Akeson, R. L.; Chen, X.; Ciardi, D.
  • Publications of the Astronomical Society of the Pacific, Vol. 125, Issue 930
  • DOI: 10.1086/672273

THE COMPOSITE SPECTRUM OF STRONG Lyα FOREST ABSORBERS
journal, November 2010


Intergalactic Helium Absorption in Cold Dark Matter Models
journal, October 1997

  • Croft, Rupert A. C.; Weinberg, David H.; Katz, Neal
  • The Astrophysical Journal, Vol. 488, Issue 2
  • DOI: 10.1086/304723

A Feature at [CLC][ITAL]z[/ITAL][/CLC] ∼ 3.2 in the Evolution of the L[CLC]y[/CLC]α Forest Optical Depth
journal, January 2003

  • Bernardi, Mariangela; Sheth, Ravi K.; SubbaRao, Mark
  • The Astronomical Journal, Vol. 125, Issue 1
  • DOI: 10.1086/344945

Mock Quasar-Lyman-α forest data-sets for the SDSS-III Baryon Oscillation Spectroscopic Survey
journal, May 2015

  • Bautista, Julian E.; Bailey, Stephen; Font-Ribera, Andreu
  • Journal of Cosmology and Astroparticle Physics, Vol. 2015, Issue 05
  • DOI: 10.1088/1475-7516/2015/05/060

Fast and Flexible ADMM Algorithms for Trend Filtering
journal, July 2016


THE CARNEGIE SUPERNOVA PROJECT: INTRINSIC COLORS OF TYPE Ia SUPERNOVAE
journal, June 2014

  • Burns, Christopher R.; Stritzinger, Maximilian; Phillips, M. M.
  • The Astrophysical Journal, Vol. 789, Issue 1
  • DOI: 10.1088/0004-637X/789/1/32

Comparative Analysis of the High- and Low-Ionization Lines in the Broad-Line Region of Active Galactic Nuclei
journal, May 1996

  • Marziani, P.; Sulentic, J. W.; Dultzin-Hacyan, D.
  • The Astrophysical Journal Supplement Series, Vol. 104
  • DOI: 10.1086/192291

The Linear Theory Power Spectrum from the Lyα Forest in the Sloan Digital Sky Survey
journal, December 2005

  • McDonald, Patrick; Seljak, Uroš; Cen, Renyue
  • The Astrophysical Journal, Vol. 635, Issue 2
  • DOI: 10.1086/497563

Evolution of the Intergalactic Opacity: Implications for the Ionizing Background, Cosmic Star Formation, and Quasar Activity
journal, November 2008

  • Faucher‐Giguère, Claude‐André; Lidz, Adam; Hernquist, Lars
  • The Astrophysical Journal, Vol. 688, Issue 1
  • DOI: 10.1086/592289

The absolute magnitudes of Type IA supernovae
journal, August 1993

  • Phillips, M. M.
  • The Astrophysical Journal, Vol. 413
  • DOI: 10.1086/186970

Spectral Classification and Redshift Measurement for the Sdss-Iii Baryon Oscillation Spectroscopic Survey
journal, October 2012


The Eleventh and Twelfth data Releases of the Sloan Digital sky Survey: Final data from Sdss-Iii
journal, July 2015

  • Alam, Shadab; Albareti, Franco D.; Prieto, Carlos Allende
  • The Astrophysical Journal Supplement Series, Vol. 219, Issue 1
  • DOI: 10.1088/0067-0049/219/1/12

The solution path of the generalized lasso
journal, June 2011

  • Tibshirani, Ryan J.; Taylor, Jonathan
  • The Annals of Statistics, Vol. 39, Issue 3
  • DOI: 10.1214/11-AOS878

OVERVIEW OF THE KEPLER SCIENCE PROCESSING PIPELINE
journal, March 2010

  • Jenkins, Jon M.; Caldwell, Douglas A.; Chandrasekaran, Hema
  • The Astrophysical Journal, Vol. 713, Issue 2
  • DOI: 10.1088/2041-8205/713/2/L87

Analytic Light Curves for Planetary Transit Searches
journal, December 2002

  • Mandel, Kaisey; Agol, Eric
  • The Astrophysical Journal, Vol. 580, Issue 2
  • DOI: 10.1086/345520

The Observability of Metal Lines Associated with the Lyα Forest
journal, May 1998

  • Hellsten, Uffe; Hernquist, Lars; Katz, Neal
  • The Astrophysical Journal, Vol. 499, Issue 1
  • DOI: 10.1086/305622

Kepler Eclipsing Binary Stars. iii. Classification of Kepler Eclipsing Binary Light Curves with Locally Linear Embedding
journal, April 2012


An Open Catalog for Supernova Data
journal, January 2017

  • Guillochon, James; Parrent, Jerod; Kelley, Luke Zoltan
  • The Astrophysical Journal, Vol. 835, Issue 1
  • DOI: 10.3847/1538-4357/835/1/64

The relationship between infrared, optical, and ultraviolet extinction
journal, October 1989

  • Cardelli, Jason A.; Clayton, Geoffrey C.; Mathis, John S.
  • The Astrophysical Journal, Vol. 345
  • DOI: 10.1086/167900

The one-dimensional Ly α forest power spectrum from BOSS
journal, November 2013

  • Palanque-Delabrouille, Nathalie; Yèche, Christophe; Borde, Arnaud
  • Astronomy & Astrophysics, Vol. 559
  • DOI: 10.1051/0004-6361/201322130

Robust Locally Weighted Regression and Smoothing Scatterplots
journal, December 1979


Kepler Planet-Detection Mission: Introduction and First Results
journal, January 2010


The man Behind the Curtain: X-Rays Drive the uv Through nir Variability in the 2013 Active Galactic Nucleus Outburst in ngc 2617
journal, May 2014


Adaptive piecewise polynomial estimation via trend filtering
journal, February 2014


Sdss-Iii: Massive Spectroscopic Surveys of the Distant Universe, the Milky way, and Extra-Solar Planetary Systems
journal, August 2011

  • Eisenstein, Daniel J.; Weinberg, David H.; Agol, Eric
  • The Astronomical Journal, Vol. 142, Issue 3
  • DOI: 10.1088/0004-6256/142/3/72

KEPLER 'S FIRST ROCKY PLANET: KEPLER-10b
journal, February 2011

  • Batalha, Natalie M.; Borucki, William J.; Bryson, Stephen T.
  • The Astrophysical Journal, Vol. 729, Issue 1
  • DOI: 10.1088/0004-637X/729/1/27

LYα FOREST TOMOGRAPHY FROM BACKGROUND GALAXIES: THE FIRST MEGAPARSEC-RESOLUTION LARGE-SCALE STRUCTURE MAP AT z > 2
journal, October 2014


The Eighth data Release of the Sloan Digital sky Survey: First data from Sdss-Iii
journal, March 2011

  • Aihara, Hiroaki; Allende Prieto, Carlos; An, Deokkeun
  • The Astrophysical Journal Supplement Series, Vol. 193, Issue 2
  • DOI: 10.1088/0067-0049/193/2/29

SN 2016coi (ASASSN-16fp): An Energetic H-stripped Core-collapse Supernova from a Massive Stellar Progenitor with Large Mass Loss
journal, September 2019


SN 2016coi/ASASSN-16fp: an example of residual helium in a typeIc supernova?
journal, May 2018

  • Prentice, S. J.; Ashall, C.; Mazzali, P. A.
  • Monthly Notices of the Royal Astronomical Society, Vol. 478, Issue 3
  • DOI: 10.1093/mnras/sty1223

Light-curve classification in massive variability surveys - II. Transients towards the Large Magellanic Cloud
journal, July 2004


Toward a Precise Measurement of Matter Clustering: Lyα Forest Data at Redshifts 2–4
journal, December 2002

  • Croft, Rupert A. C.; Weinberg, David H.; Bolte, Mike
  • The Astrophysical Journal, Vol. 581, Issue 1
  • DOI: 10.1086/344099

ASASSN-16fp (SN 2016coi): a transitional supernova between Type Ic and broad-lined Ic
journal, September 2017

  • Kumar, Brajesh; Singh, A.; Srivastav, S.
  • Monthly Notices of the Royal Astronomical Society, Vol. 473, Issue 3
  • DOI: 10.1093/mnras/stx2498

THE CARNEGIE SUPERNOVA PROJECT: LIGHT-CURVE FITTING WITH SNooPy
journal, December 2010

  • Burns, Christopher R.; Stritzinger, Maximilian; Phillips, M. M.
  • The Astronomical Journal, Vol. 141, Issue 1
  • DOI: 10.1088/0004-6256/141/1/19

Measuring Reddening with Sloan Digital sky Survey Stellar Spectra and Recalibrating sfd
journal, August 2011


KEPLER ECLIPSING BINARY STARS. II. 2165 ECLIPSING BINARIES IN THE SECOND DATA RELEASE
journal, October 2011


Neutrino masses and cosmology with Lyman-alpha forest power spectrum
journal, November 2015

  • Palanque-Delabrouille, Nathalie; Yèche, Christophe; Baur, Julien
  • Journal of Cosmology and Astroparticle Physics, Vol. 2015, Issue 11
  • DOI: 10.1088/1475-7516/2015/11/011

The power spectrum of the flux distribution in the Lyman   forest of a large sample of UVES QSO absorption spectra (LUQAS)
journal, January 2004


KEPLER ECLIPSING BINARY STARS. I. CATALOG AND PRINCIPAL CHARACTERIZATION OF 1879 ECLIPSING BINARIES IN THE FIRST DATA RELEASE
journal, February 2011


SOUSA: the Swift Optical/Ultraviolet Supernova Archive
journal, July 2014

  • Brown, Peter J.; Breeveld, Alice A.; Holland, Stephen
  • Astrophysics and Space Science, Vol. 354, Issue 1
  • DOI: 10.1007/s10509-014-2059-8

KEPLER-10 c: A 2.2 EARTH RADIUS TRANSITING PLANET IN A MULTIPLE SYSTEM
journal, October 2011

  • Fressin, François; Torres, Guillermo; Désert, Jean-Michel
  • The Astrophysical Journal Supplement Series, Vol. 197, Issue 1
  • DOI: 10.1088/0067-0049/197/1/5

A principal component analysis of quasar UV spectra at z  ~  3
journal, May 2011


Pressure support versus thermal broadening in the Lyman α forest - I. Effects of the equation of state on longitudinal structure
journal, March 2010


Artificial Intelligence Approach to the Determination of Physical Properties of Eclipsing Binaries. I. The EBAI Project
journal, November 2008

  • Prša, A.; Guinan, E. F.; Devinney, E. J.
  • The Astrophysical Journal, Vol. 687, Issue 1
  • DOI: 10.1086/591783

The Lyman Alpha Forest in the Spectra of Quasistellar Objects
journal, September 1998


A wavelet analysis of the spectra of quasi-stellar objects
journal, October 2000