A generalised background correction algorithm for a Halo Doppler lidar and its application to data from Finland
Abstract
Current commercially available Doppler lidars provide an economical and robust solution for measuring vertical and horizontal wind velocities, together with the ability to provide co- and cross-polarised backscatter profiles. The high temporal resolution of these instruments allows turbulent properties to be obtained from studying the variation in radial velocities. However, the instrument specifications mean that certain characteristics, especially the background noise behaviour, become a limiting factor for the instrument sensitivity in regions where the aerosol load is low. Turbulent calculations require an accurate estimate of the contribution from velocity uncertainty estimates, which are directly related to the signal-to-noise ratio. Any bias in the signal-to-noise ratio will propagate through as a bias in turbulent properties. In this paper we present a method to correct for artefacts in the background noise behaviour of commercially available Doppler lidars and reduce the signal-to-noise ratio threshold used to discriminate between noise, and cloud or aerosol signals. We show that, for Doppler lidars operating continuously at a number of locations in Finland, the data availability can be increased by as much as 50 % after performing this background correction and subsequent reduction in the threshold. Furthermore the reduction in bias also greatly improves subsequent calculations ofmore »
- Authors:
-
- Univ. of Helsinki, Helsinki (Finland)
- Finnish Meteorological Institute, Helsinki (Finland); Univ. of Reading, Reading (United Kingdom)
- Finnish Meteorological Institute, Helsinki (Finland)
- Publication Date:
- Research Org.:
- Univ. of Helsinki, Helsinki (Finland). Dept. of Physics
- Sponsoring Org.:
- USDOE
- OSTI Identifier:
- 1375419
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Atmospheric Measurement Techniques (Online)
- Additional Journal Information:
- Journal Name: Atmospheric Measurement Techniques (Online); Journal Volume: 9; Journal Issue: 2; Journal ID: ISSN 1867-8548
- Publisher:
- European Geosciences Union
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 54 ENVIRONMENTAL SCIENCES
Citation Formats
Manninen, Antti J., O'Connor, Ewan J., Vakkari, Ville, and Petaja, Tuukka. A generalised background correction algorithm for a Halo Doppler lidar and its application to data from Finland. United States: N. p., 2016.
Web. doi:10.5194/amt-9-817-2016.
Manninen, Antti J., O'Connor, Ewan J., Vakkari, Ville, & Petaja, Tuukka. A generalised background correction algorithm for a Halo Doppler lidar and its application to data from Finland. United States. https://doi.org/10.5194/amt-9-817-2016
Manninen, Antti J., O'Connor, Ewan J., Vakkari, Ville, and Petaja, Tuukka. Thu .
"A generalised background correction algorithm for a Halo Doppler lidar and its application to data from Finland". United States. https://doi.org/10.5194/amt-9-817-2016. https://www.osti.gov/servlets/purl/1375419.
@article{osti_1375419,
title = {A generalised background correction algorithm for a Halo Doppler lidar and its application to data from Finland},
author = {Manninen, Antti J. and O'Connor, Ewan J. and Vakkari, Ville and Petaja, Tuukka},
abstractNote = {Current commercially available Doppler lidars provide an economical and robust solution for measuring vertical and horizontal wind velocities, together with the ability to provide co- and cross-polarised backscatter profiles. The high temporal resolution of these instruments allows turbulent properties to be obtained from studying the variation in radial velocities. However, the instrument specifications mean that certain characteristics, especially the background noise behaviour, become a limiting factor for the instrument sensitivity in regions where the aerosol load is low. Turbulent calculations require an accurate estimate of the contribution from velocity uncertainty estimates, which are directly related to the signal-to-noise ratio. Any bias in the signal-to-noise ratio will propagate through as a bias in turbulent properties. In this paper we present a method to correct for artefacts in the background noise behaviour of commercially available Doppler lidars and reduce the signal-to-noise ratio threshold used to discriminate between noise, and cloud or aerosol signals. We show that, for Doppler lidars operating continuously at a number of locations in Finland, the data availability can be increased by as much as 50 % after performing this background correction and subsequent reduction in the threshold. Furthermore the reduction in bias also greatly improves subsequent calculations of turbulent properties in weak signal regimes.},
doi = {10.5194/amt-9-817-2016},
journal = {Atmospheric Measurement Techniques (Online)},
number = 2,
volume = 9,
place = {United States},
year = {Thu Mar 03 00:00:00 EST 2016},
month = {Thu Mar 03 00:00:00 EST 2016}
}
Web of Science
Works referenced in this record:
Aerosol-cloud semi-direct effect and land-sea temperature contrast in a GCM: AEROSOL EFFECT ON CLOUDS
journal, April 2010
- Allen, R. J.; Sherwood, S. C.
- Geophysical Research Letters, Vol. 37, Issue 7
Aerosol decadal trends – Part 2: In-situ aerosol particle number concentrations at GAW and ACTRIS stations
journal, January 2013
- Asmi, A.; Collaud Coen, M.; Ogren, J. A.
- Atmospheric Chemistry and Physics, Vol. 13, Issue 2
Robust direct effect of carbon dioxide on tropical circulation and regional precipitation
journal, April 2013
- Bony, Sandrine; Bellon, Gilles; Klocke, Daniel
- Nature Geoscience, Vol. 6, Issue 6
Aerosol decadal trends – Part 1: In-situ optical measurements at GAW and IMPROVE stations
journal, January 2013
- Collaud Coen, M.; Andrews, E.; Asmi, A.
- Atmospheric Chemistry and Physics, Vol. 13, Issue 2
Detection of Influential Observation in Linear Regression
journal, February 1977
- Cook, R. Dennis
- Technometrics, Vol. 19, Issue 1
Surface-based remote sensing of the mixing-layer height a review [Surface-based remote sensing of the mixing-layer height a review]
journal, October 2008
- Emeis, Stefan; Schäfer, Klaus; Münkel, Christoph
- Meteorologische Zeitschrift, Vol. 17, Issue 5
A method to diagnose boundary-layer type using Doppler lidar: A Method to Diagnose Boundary-Layer Type
journal, January 2013
- Harvey, Natalie J.; Hogan, Robin J.; Dacre, Helen F.
- Quarterly Journal of the Royal Meteorological Society, Vol. 139, Issue 676
Observing wind, aerosol particles, cloud and precipitation: Finland's new ground-based remote-sensing network
journal, January 2014
- Hirsikko, A.; O'Connor, E. J.; Komppula, M.
- Atmospheric Measurement Techniques, Vol. 7, Issue 5
The Hat Matrix in Regression and ANOVA
journal, February 1978
- Hoaglin, David C.; Welsch, Roy E.
- The American Statistician, Vol. 32, Issue 1
Sensitivity studies of different aerosol indirect effects in mixed-phase clouds
journal, January 2009
- Lohmann, U.; Hoose, C.
- Atmospheric Chemistry and Physics, Vol. 9, Issue 22
A Method for Estimating the Turbulent Kinetic Energy Dissipation Rate from a Vertically Pointing Doppler Lidar, and Independent Evaluation from Balloon-Borne In Situ Measurements
journal, October 2010
- O’Connor, Ewan J.; Illingworth, Anthony J.; Brooks, Ian M.
- Journal of Atmospheric and Oceanic Technology, Vol. 27, Issue 10
An assessment of the performance of a 1.5 μm Doppler lidar for operational vertical wind profiling based on a 1-year trial
journal, January 2015
- Päschke, E.; Leinweber, R.; Lehmann, V.
- Atmospheric Measurement Techniques, Vol. 8, Issue 6
An Analysis of the Performance of the UFAM Pulsed Doppler Lidar for Observing the Boundary Layer
journal, February 2009
- Pearson, Guy; Davies, Fay; Collier, Chris
- Journal of Atmospheric and Oceanic Technology, Vol. 26, Issue 2
Remote sensing of the tropical rain forest boundary layer using pulsed Doppler lidar
journal, January 2010
- Pearson, G.; Davies, F.; Collier, C.
- Atmospheric Chemistry and Physics, Vol. 10, Issue 13
Discrete spectral peak estimation in incoherent backscatter heterodyne lidar. I. Spectral accumulation and the Cramer-Rao lower bound
journal, January 1993
- Rye, B. J.; Hardesty, R. M.
- IEEE Transactions on Geoscience and Remote Sensing, Vol. 31, Issue 1
Low-level mixing height detection in coastal locations with a scanning Doppler lidar
journal, January 2015
- Vakkari, V.; O'Connor, E. J.; Nisantzi, A.
- Atmospheric Measurement Techniques, Vol. 8, Issue 4
Can the direct and semi-direct aerosol effect compete with the indirect effect on a global scale?
journal, January 2001
- Lohmann, Ulrike; Feichter, Johann
- Geophysical Research Letters, Vol. 28, Issue 1
The Hat Matrix in Regression and ANOVA
journal, February 1978
- Hoaglin, David C.; Welsch, Roy E.
- The American Statistician, Vol. 32, Issue 1
Aerosol decadal trends – Part 1: In-situ optical measurements at GAW and IMPROVE stations
journal, January 2012
- Collaud Coen, M.; Andrews, E.; Asmi, A.
- Atmospheric Chemistry and Physics Discussions, Vol. 12, Issue 8
Surface-based remote sensing of the mixing-layer height - a review
text, January 2008
- Emeis, Stefan; Schäfer, Klaus; Münkel, Christoph
- Karlsruhe
Works referencing / citing this record:
MEMS-based lidar for autonomous driving
journal, July 2018
- Yoo, Han Woong; Druml, Norbert; Brunner, David
- e & i Elektrotechnik und Informationstechnik, Vol. 135, Issue 6
Atmospheric Boundary Layer Classification With Doppler Lidar
journal, August 2018
- Manninen, A. J.; Marke, T.; Tuononen, M.
- Journal of Geophysical Research: Atmospheres, Vol. 123, Issue 15
Wind Gust Measurement Techniques—From Traditional Anemometry to New Possibilities
journal, April 2018
- Suomi, Irene; Vihma, Timo
- Sensors, Vol. 18, Issue 4
Carrier-to-Noise-Threshold Filtering on Off-Shore Wind Lidar Measurements
journal, January 2019
- Gryning, Sven-Erik; Floors, Rogier
- Sensors, Vol. 19, Issue 3
Long-term measurements of volatile organic compounds highlight the importance of sesquiterpenes for the atmospheric chemistry of a boreal forest
journal, January 2018
- Hellén, Heidi; Praplan, Arnaud P.; Tykkä, Toni
- Atmospheric Chemistry and Physics, Vol. 18, Issue 19
A novel post-processing algorithm for Halo Doppler lidars
journal, January 2019
- Vakkari, Ville; Manninen, Antti J.; O'Connor, Ewan J.
- Atmospheric Measurement Techniques, Vol. 12, Issue 2
Recommendations for processing atmospheric attenuated backscatter profiles
from Vaisala CL31 ceilometers
journal, January 2016
- Kotthaus, Simone; O'Connor, Ewan; Münkel, Christoph
- Atmospheric Measurement Techniques, Vol. 9, Issue 8
Lidar observations of atmospheric internal waves in the boundary layer of
the atmosphere on the coast of Lake Baikal
journal, January 2016
- Banakh, Viktor A.; Smalikho, Igor N.
- Atmospheric Measurement Techniques, Vol. 9, Issue 10
Methodology for obtaining wind gusts using Doppler lidar: Wind Gust Measurements Using Doppler Lidar
journal, June 2017
- Suomi, Irene; Gryning, Sven-Erik; O'Connor, Ewan J.
- Quarterly Journal of the Royal Meteorological Society, Vol. 143, Issue 706
Low-Level Jets over Utö, Finland, Based on Doppler Lidar Observations
journal, September 2017
- Tuononen, Minttu; O’Connor, Ewan J.; Sinclair, Victoria A.
- Journal of Applied Meteorology and Climatology, Vol. 56, Issue 9
Wind Gust Measurement Techniques—From Traditional Anemometry to New Possibilities
journal, April 2018
- Suomi, Irene; Vihma, Timo
- Sensors, Vol. 18, Issue 4
Long-term measurements of volatile organic compounds highlight the importance of sesquiterpenes for the atmospheric chemistry of a boreal forest
journal, January 2018
- Hellén, Heidi; Praplan, Arnaud P.; Tykkä, Toni
- Atmospheric Chemistry and Physics, Vol. 18, Issue 19
Methodology for deriving the telescope focus function and its uncertainty for a heterodyne pulsed Doppler lidar
journal, January 2020
- Pentikäinen, Pyry; O'Connor, Ewan James; Manninen, Antti Juhani
- Atmospheric Measurement Techniques, Vol. 13, Issue 5
LiSBOA (LiDAR Statistical Barnes Objective Analysis) for optimal design of lidar scans and retrieval of wind statistics – Part 1: Theoretical framework
journal, March 2021
- Letizia, Stefano; Zhan, Lu; Iungo, Giacomo Valerio
- Atmospheric Measurement Techniques, Vol. 14, Issue 3
Recommendations for processing atmospheric attenuated backscatter profiles
from Vaisala CL31 ceilometers
journal, January 2016
- Kotthaus, Simone; O'Connor, Ewan; Münkel, Christoph
- Atmospheric Measurement Techniques, Vol. 9, Issue 8