Using Convex Optimization to Efficiently Apportion Tracer and Pollutant Sources From Point Concentration Observations

Barnes, Richard; Lipp, Alex G.

doi:10.1029/2023WR036159

Title: Using Convex Optimization to Efficiently Apportion Tracer and Pollutant Sources From Point Concentration Observations

Journal Article · 16 May 2024 · Water Resources Research

DOI: https://doi.org/10.1029/2023WR036159 · OSTI ID:2352345

^[1];

^[2]

Lawrence Berkeley National Lab Berkeley CA USA
Merton College University of Oxford Oxford UK

Abstract Rivers transport elements, minerals, chemicals, and pollutants produced in their upstream basins. A sample from a river is a mixture of all of its upstream sources, making it challenging to pinpoint the contribution from each individual source. Here, we show how a nested sample design and convex optimization can be used to efficiently unmix downstream samples of a well‐mixed, conservative tracer in a steady state system into the contributions of their upstream sources. Our approach is significantly faster than previous methods. We represent the river's sub‐catchments, defined by sampling sites, using a directed acyclic graph. This graph is used to build a convex optimization problem which, thanks to its convexity, can be quickly solved to global optimality—in under a second on desktop hardware for data sets of ∼100 samples or fewer. Uncertainties in the upstream predictions can be generated using Monte Carlo resampling. We provide an open‐source implementation of this approach in Python. The inputs required are straightforward: a table containing sample locations and observed tracer concentrations, along with a D8 flow‐direction raster map. As a case study, we use this method to map the elemental geochemistry of sediment sources for rivers draining the Cairngorms mountains, UK. This method could be extended to non‐conservative and non‐steady state tracers. We also show, theoretically, how multiple tracers could be simultaneously inverted to recover upstream run‐off or erosion rates as well as source concentrations. Overall, this approach can provide valuable insights to researchers in various fields, including water quality, geochemical exploration, geochemistry, hydrology, and wastewater epidemiology.

View Journal Article

Cite

Export

Save

Sponsoring Organization:: USDOE

OSTI ID:: 2352345

Journal Information:: Water Resources Research, Journal Name: Water Resources Research Journal Issue: 5 Vol. 60; ISSN 0043-1397

Publisher:: American Geophysical Union (AGU)Copyright Statement

Country of Publication:: United States

Language:: English

References (48)

Mixing as a driver of temporal variations in river hydrochemistry: 2. Major and trace element concentration dynamics in the Andes-Amazon transition: MAJOR AND TRACE ELEMENT C-Q MIXING Baronas, J. Jotautas; Torres, Mark A.; Clark, Kathryn E. Water Resources Research, Vol. 53, Issue 4 https://doi.org/10.1002/2016WR019729	journal	April 2017
Mixing as a driver of temporal variations in river hydrochemistry: 1. Insights from conservative tracers in the Andes-Amazon transition: ANDES-AMAZON TRIBUTARY MIXING Torres, Mark A.; Baronas, J. Jotautas; Clark, Kathryn E. Water Resources Research, Vol. 53, Issue 4 https://doi.org/10.1002/2016WR019733	journal	April 2017
An Introduction to Statistical Learning James, Gareth; Witten, Daniela; Hastie, Trevor Springer Texts in Statistics https://doi.org/10.1007/978-1-4614-7138-7	book	January 2013
A Practical Guide to the Use of Major Elements, Trace Elements, and Isotopes in Compositional Data Analysis: Applications for Deep Formation Brine Geochemistry Blondes, M. S.; Engle, M. A.; Geboy, N. J. Compositional Data Analysis https://doi.org/10.1007/978-3-319-44811-4_2	preprint	November 2016
Efficient BackProp LeCun, Yann A.; Bottou, Léon; Orr, Genevieve B. Lecture Notes in Computer Science https://doi.org/10.1007/978-3-642-35289-8_3	book	January 2012
End-member modeling of compositional data: Numerical-statistical algorithms for solving the explicit mixing problem Weltje, Gert Jan Mathematical Geology, Vol. 29, Issue 4 https://doi.org/10.1007/BF02775085	journal	May 1997
Priority-flood: An optimal depression-filling and watershed-labeling algorithm for digital elevation models Barnes, Richard; Lehman, Clarence; Mulla, David Computers & Geosciences, Vol. 62 https://doi.org/10.1016/j.cageo.2013.04.024	journal	January 2014
Parallel Priority-Flood depression filling for trillion cell digital elevation models on desktops or clusters Barnes, Richard Computers & Geosciences, Vol. 96 https://doi.org/10.1016/j.cageo.2016.07.001	journal	November 2016
Provenance versus weathering control on the composition of tropical river mud (southern Africa) Garzanti, Eduardo; Padoan, Marta; Setti, Massimo Chemical Geology, Vol. 366 https://doi.org/10.1016/j.chemgeo.2013.12.016	journal	February 2014
Future perspectives of wastewater-based epidemiology: Monitoring infectious disease spread and resistance to the community level Sims, Natalie; Kasprzyk-Hordern, Barbara Environment International, Vol. 139 https://doi.org/10.1016/j.envint.2020.105689	journal	June 2020
The control mechanisms of erosion and weathering at basin scale from cosmogenic nuclides in river sediment von Blanckenburg, Friedhelm Earth and Planetary Science Letters, Vol. 237, Issue 3-4 https://doi.org/10.1016/j.epsl.2005.06.030	journal	September 2005
Turbulent mixing in the Amazon River: The isotopic memory of confluences Bouchez, Julien; Lajeunesse, Eric; Gaillardet, Jérôme Earth and Planetary Science Letters, Vol. 290, Issue 1-2 https://doi.org/10.1016/j.epsl.2009.11.054	journal	February 2010
Fingerprinting changes of source apportionments from mixed land uses in stream sediments before and after an exceptional rainstorm event Lizaga, Ivan; Gaspar, Leticia; Blake, William H. Geomorphology, Vol. 341 https://doi.org/10.1016/j.geomorph.2019.05.015	journal	September 2019
Geochemical mapping by unmixing alluvial sediments: An example from northern Australia Lipp, Alex G.; de Caritat, Patrice; Roberts, Gareth G. Journal of Geochemical Exploration, Vol. 248 https://doi.org/10.1016/j.gexplo.2023.107174	journal	May 2023
Quantifying excess heavy metal concentrations in drainage basins using conservative mixing models Eschenfelder, Jonas; Lipp, Alex G.; Roberts, Gareth G. Journal of Geochemical Exploration, Vol. 248 https://doi.org/10.1016/j.gexplo.2023.107178	journal	May 2023
Multivariate statistical approach to estimate mixing proportions for unknown end members Valder, Joshua F.; Long, Andrew J.; Davis, Arden D. Journal of Hydrology, Vol. 460-461 https://doi.org/10.1016/j.jhydrol.2012.06.037	journal	August 2012
Tracing suspended sediment sources in catchments and river systems Walling, D. E. Science of The Total Environment, Vol. 344, Issue 1-3 https://doi.org/10.1016/j.scitotenv.2005.02.011	journal	May 2005
Modelling of phosphorus inputs to rivers from diffuse and point sources Bowes, Michael J.; Smith, Jim T.; Jarvie, Helen P. Science of The Total Environment, Vol. 395, Issue 2-3 https://doi.org/10.1016/j.scitotenv.2008.01.054	journal	June 2008
Fate of wastewater contaminants in rivers: Using conservative-tracer based transfer functions to assess reactive transport Guillet, Gaëlle; Knapp, Julia L. A.; Merel, Sylvain Science of The Total Environment, Vol. 656 https://doi.org/10.1016/j.scitotenv.2018.11.379	journal	March 2019
Evaluation of combined sewer overflow impacts on short-term pharmaceutical and illicit drug occurrence in a heavily urbanised tidal river catchment (London, UK) Munro, Kelly; Martins, Claudia P. B.; Loewenthal, Matthew Science of The Total Environment, Vol. 657 https://doi.org/10.1016/j.scitotenv.2018.12.108	journal	March 2019
Routine stream monitoring data enables the unravelling of hydrological pathways and transfers of agricultural contaminants through catchments Stenger, Roland; Park, Jungho; Clague, Juliet Science of The Total Environment, Vol. 912 https://doi.org/10.1016/j.scitotenv.2023.169370	journal	February 2024
Convex Optimization Boyd, Stephen; Vandenberghe, Lieven https://doi.org/10.1017/CBO9780511804441	book	January 2004
Sensors in the Stream: The High-Frequency Wave of the Present Rode, Michael; Wade, Andrew J.; Cohen, Matthew J. Environmental Science & Technology, Vol. 50, Issue 19 https://doi.org/10.1021/acs.est.6b02155	journal	September 2016
Dealing with Zeros and Missing Values in Compositional Data Sets Using Nonparametric Imputation Martín-Fernández, J. A. Mathematical Geology, Vol. 35, Issue 3, p. 253-278 https://doi.org/10.1023/A:1023866030544	journal	April 2003
A methodology to compute mixing ratios with uncertain end-members: METHODOLOGY TO COMPUTE MIXING RATIOS Carrera, J.; Vázquez-Suñé, E.; Castillo, O. Water Resources Research, Vol. 40, Issue 12 https://doi.org/10.1029/2003WR002263	journal	December 2004
Mapping outlet points used for watershed delineation onto DEM‐derived stream networks Lindsay, John B.; Rothwell, James J.; Davies, Helen Water Resources Research, Vol. 44, Issue 8 https://doi.org/10.1029/2007WR006507	journal	August 2008
River Sediment Geochemistry as a Conservative Mixture of Source Regions: Observations and Predictions From the Cairngorms, UK Lipp, Alex G.; Roberts, Gareth G.; Whittaker, Alexander C. Journal of Geophysical Research: Earth Surface, Vol. 125, Issue 12 https://doi.org/10.1029/2020JF005700	journal	December 2020
Optimal Transport for Assessing Nitrate Source‐Pathway Connectivity Husic, Admin; Fox, James; Mahoney, Tyler Water Resources Research, Vol. 56, Issue 10 https://doi.org/10.1029/2020WR027446	journal	October 2020
Source Region Geochemistry From Unmixing Downstream Sedimentary Elemental Compositions Lipp, Alex G.; Roberts, Gareth G.; Whittaker, Alexander C. Geochemistry, Geophysics, Geosystems, Vol. 22, Issue 10 https://doi.org/10.1029/2021GC009838	journal	October 2021
Transit Time Estimation in Catchments: Recent Developments and Future Directions Benettin, Paolo; Rodriguez, Nicolas B.; Sprenger, Matthias Water Resources Research, Vol. 58, Issue 11 https://doi.org/10.1029/2022WR033096	journal	November 2022
Temporal Variability of Fluvial Sand Composition: An Annual Time Series From Four Rivers in SW Germany Stutenbecker, L.; Scheuvens, D.; Hinderer, M. Journal of Geophysical Research: Earth Surface, Vol. 128, Issue 6 https://doi.org/10.1029/2023JF007138	journal	June 2023
Estimating species distribution and abundance in river networks using environmental DNA Carraro, Luca; Hartikainen, Hanna; Jokela, Jukka Proceedings of the National Academy of Sciences, Vol. 115, Issue 46 https://doi.org/10.1073/pnas.1813843115	journal	October 2018
Development and demonstration of a structured hydrological feature coding system for Europe de Jager, A. L.; Vogt, J. V. Hydrological Sciences Journal, Vol. 55, Issue 5 https://doi.org/10.1080/02626667.2010.490786	journal	July 2010
Wastewater Surveillance for Infectious Disease: A Systematic Review Kilaru, Pruthvi; Hill, Dustin; Anderson, Kathryn American Journal of Epidemiology, Vol. 192, Issue 2 https://doi.org/10.1093/aje/kwac175	journal	October 2022
Convex Optimization in Julia Udell, Madeleine; Mohan, Karanveer; Zeng, David 2014 First Workshop for High Performance Technical Computing in Dynamic Languages (HPTCDL) https://doi.org/10.1109/HPTCDL.2014.5	conference	November 2014
Determining the number of clusters/segments in hierarchical clustering/segmentation algorithms Salvador, S.; Chan, P. 16th IEEE International Conference on Tools with Artificial Intelligence https://doi.org/10.1109/ICTAI.2004.50	conference	November 2004
Verification, Validation, and Confirmation of Numerical Models in the Earth Sciences Oreskes, N.; Shrader-Frechette, K.; Belitz, K. Science, Vol. 263, Issue 5147 https://doi.org/10.1126/science.263.5147.641	journal	February 1994
Compositional data and their analysis: an introduction Pawlowsky-Glahn, V.; Egozcue, J. J. Geological Society, London, Special Publications, Vol. 264, Issue 1 https://doi.org/10.1144/gsl.sp.2006.264.01.01	journal	January 2006
Stop using the elbow criterion for k-means and how to choose the number of clusters instead Schubert, Erich ACM SIGKDD Explorations Newsletter, Vol. 25, Issue 1 https://doi.org/10.1145/3606274.3606278	journal	June 2023
Occam’s inversion: A practical algorithm for generating smooth models from electromagnetic sounding data Constable, Steven C.; Parker, Robert L.; Constable, Catherine G. GEOPHYSICS, Vol. 52, Issue 3 https://doi.org/10.1190/1.1442303	journal	March 1987
Finding the Number of Clusters in a Dataset: An Information-Theoretic Approach Sugar, Catherine A.; James, Gareth M. Journal of the American Statistical Association, Vol. 98, Issue 463 https://doi.org/10.1198/016214503000000666	journal	September 2003
Placing sensors in sewer networks: A system to pinpoint new cases of coronavirus Nourinejad, Mehdi; Berman, Oded; Larson, Richard C. PLOS ONE, Vol. 16, Issue 4 https://doi.org/10.1371/journal.pone.0248893	journal	April 2021
Hypothesis: A new approach to property-based testing MacIver, David; Hatfield-Dodds, Zac; Contributors, Many Journal of Open Source Software, Vol. 4, Issue 43 https://doi.org/10.21105/joss.01891	journal	November 2019
ECOS: An SOCP solver for embedded systems Domahidi, Alexander; Chu, Eric; Boyd, Stephen 2013 European Control Conference (ECC) https://doi.org/10.23919/ECC.2013.6669541	conference	July 2013
Presentation and applications of mixing elements and dissolved isotopes in rivers (MEANDIR), a customizable MATLAB model for Monte Carlo inversion of dissolved river chemistry Kemeny, Preston Cosslett; Torres, Mark Albert American Journal of Science, Vol. 321, Issue 5 https://doi.org/10.2475/05.2021.03	journal	May 2021
Studies of longitudinal stream profiles in Virginia and Maryland Hack, J. T. USGS Numbered Series https://doi.org/10.3133/pp294B	report	January 1957
Identifying tracer and pollutant sources in drainage networks from point observations using an efficient convex unmixing scheme Alexander, Lipp; Richard, Barnes https://doi.org/10.5281/zenodo.8299812	software	August 2023
Analyzing mixing systems using a new generation of Bayesian tracer mixing models Stock, Brian C.; Jackson, Andrew L.; Ward, Eric J. PeerJ, Vol. 6 https://doi.org/10.7717/peerj.5096	journal	June 2018

Similar Records

Constructing Convex Inner Approximations of Steady-State Security Regions

Journal Article · 2018 · IEEE Transactions on Power Systems · OSTI ID:1468954

Nguyen, Hung Dinh; Dvijotham, Krishnamurthy; Turitsyn, Konstantin

Linear programming quadratic convexity, and distance geometry

Conference · 1994 · OSTI ID:35810

Barvinok, A

Application of convex sampling in optimization

Conference · 1994 · OSTI ID:36308

Mount, J

Title: Using Convex Optimization to Efficiently Apportion Tracer and Pollutant Sources From Point Concentration Observations

Citation Formats

References (48)

Similar Records

Related Subjects