A Review of Approaches for Monitoring the Effectiveness of Regional River Habitat Restoration Programs
Abstract
Abstract Large regional programs to restore riverine habitat for fish and aquatic organisms have become common throughout North America, Europe, and elsewhere. Evaluating the effectiveness of projects implemented under these programs—sometimes called programmatic monitoring and evaluation—has proven challenging, and little guidance exists on programmatic monitoring and evaluation approaches and their effectiveness. In this paper, we review different approaches for evaluating the effectiveness of river restoration projects implemented across a region. These programmatic monitoring and evaluation approaches include case studies, meta‐analyses, multiple before–after control–impact ( mBACI ), extensive posttreatment ( EPT ), intensively monitored watersheds ( IMW s), and hybrid programmatic approaches that use a combination of different experimental designs. For each approach, we discuss the pros and cons as well as provide examples. The most appropriate approach depends in part on the questions that the programmatic monitoring and evaluation strives to address, the spatial and temporal scale at which detection of a response is expected, and the scale of inference. Case studies and mBACI approaches can answer questions about individual projects but have several limitations in terms of cost, timely results, and feasibility. A meta‐analysis, which can provide broadly applicable results, is dependent upon a large number of case studiesmore »
- Authors:
-
- Cramer Fish Sciences Watershed Sciences Lab 1125 12th Avenue Northwest, Suite B‐1 Issaquah Washington 98027 USA, School of Aquatic and Fishery Sciences University of Washington 1122 Northeast Boat Street Seattle Washington 98105 USA
- Eawag, Swiss Federal Institute of Aquatic Science and Technology Department of Surface Waters, Research and Management Seestrasse 79 6047 Kastanienbaum Switzerland
- Publication Date:
- Sponsoring Org.:
- USDOE
- OSTI Identifier:
- 1476660
- Resource Type:
- Publisher's Accepted Manuscript
- Journal Name:
- North American Journal of Fisheries Management
- Additional Journal Information:
- Journal Name: North American Journal of Fisheries Management Journal Volume: 38 Journal Issue: 5; Journal ID: ISSN 0275-5947
- Publisher:
- Wiley Blackwell (John Wiley & Sons)
- Country of Publication:
- United States
- Language:
- English
Citation Formats
Roni, Philip, Åberg, Ulrika, and Weber, Christine. A Review of Approaches for Monitoring the Effectiveness of Regional River Habitat Restoration Programs. United States: N. p., 2018.
Web. doi:10.1002/nafm.10222.
Roni, Philip, Åberg, Ulrika, & Weber, Christine. A Review of Approaches for Monitoring the Effectiveness of Regional River Habitat Restoration Programs. United States. https://doi.org/10.1002/nafm.10222
Roni, Philip, Åberg, Ulrika, and Weber, Christine. Fri .
"A Review of Approaches for Monitoring the Effectiveness of Regional River Habitat Restoration Programs". United States. https://doi.org/10.1002/nafm.10222.
@article{osti_1476660,
title = {A Review of Approaches for Monitoring the Effectiveness of Regional River Habitat Restoration Programs},
author = {Roni, Philip and Åberg, Ulrika and Weber, Christine},
abstractNote = {Abstract Large regional programs to restore riverine habitat for fish and aquatic organisms have become common throughout North America, Europe, and elsewhere. Evaluating the effectiveness of projects implemented under these programs—sometimes called programmatic monitoring and evaluation—has proven challenging, and little guidance exists on programmatic monitoring and evaluation approaches and their effectiveness. In this paper, we review different approaches for evaluating the effectiveness of river restoration projects implemented across a region. These programmatic monitoring and evaluation approaches include case studies, meta‐analyses, multiple before–after control–impact ( mBACI ), extensive posttreatment ( EPT ), intensively monitored watersheds ( IMW s), and hybrid programmatic approaches that use a combination of different experimental designs. For each approach, we discuss the pros and cons as well as provide examples. The most appropriate approach depends in part on the questions that the programmatic monitoring and evaluation strives to address, the spatial and temporal scale at which detection of a response is expected, and the scale of inference. Case studies and mBACI approaches can answer questions about individual projects but have several limitations in terms of cost, timely results, and feasibility. A meta‐analysis, which can provide broadly applicable results, is dependent upon a large number of case studies being completed. The EPT approach can provide relatively quick and easy‐to‐interpret results, but it requires a large population of completed projects and careful selection of controls. The IMW approach has been broadly applied in western North America but has had limited success and appears to be tractable only in small catchments where restoration and monitoring can be well controlled. Based on results from recent efforts in the USA and Europe, the most feasible programmatic monitoring and evaluation approach in terms of cost, implementability, and production of timely results appears to be a hybrid approach that uses a combination of the EPT and mBACI approaches.},
doi = {10.1002/nafm.10222},
journal = {North American Journal of Fisheries Management},
number = 5,
volume = 38,
place = {United States},
year = {Fri Oct 05 00:00:00 EDT 2018},
month = {Fri Oct 05 00:00:00 EDT 2018}
}
Free Publicly Available Full Text
Publisher's Version of Record
https://doi.org/10.1002/nafm.10222
https://doi.org/10.1002/nafm.10222
Other availability
Search WorldCat to find libraries that may hold this journal
Cited by: 22 works
Citation information provided by
Web of Science
Web of Science
Save to My Library
You must Sign In or Create an Account in order to save documents to your library.
Works referenced in this record:
Designs for Evaluating Local and Regional Scale Trends
journal, January 2001
- Larsen, David P.; Kincaid, Thomas M.; Jacobs, Steven E.
- BioScience, Vol. 51, Issue 12
Effect Size in Ecological Experiments: The Application of Biological Models in Meta‐Analysis
journal, December 1997
- Osenberg, Craig W.; Sarnelle, Orlando; Cooper, Scott D.
- The American Naturalist, Vol. 150, Issue 6
Do in-stream restoration structures enhance salmonid abundance? A meta-analysis
journal, May 2010
- Whiteway, Sarah L.; Biron, Pascale M.; Zimmermann, André
- Canadian Journal of Fisheries and Aquatic Sciences, Vol. 67, Issue 5
Effects of increasing winter rearing habitat on abundance of salmonids in two coastal Oregon streams
journal, May 2000
- Solazzi, M. F.; Nickelson, T. E.; Johnson, S. L.
- Canadian Journal of Fisheries and Aquatic Sciences, Vol. 57, Issue 5
Rehabilitation of bedrock stream channels: the effects of boulder weir placement on aquatic habitat and biota
journal, January 2006
- Roni, Phil; Bennett, Todd; Morley, Sarah
- River Research and Applications, Vol. 22, Issue 9
Global Review of the Physical and Biological Effectiveness of Stream Habitat Rehabilitation Techniques
journal, June 2008
- Roni, Phil; Hanson, Karrie; Beechie, Tim
- North American Journal of Fisheries Management, Vol. 28, Issue 3
Effects of Wood Placement on Movements of Trout and Juvenile Coho Salmon in Natural and Artificial Stream Channels
journal, July 2001
- Roni, Philip; Quinn, Thomas P.
- Transactions of the American Fisheries Society, Vol. 130, Issue 4
Hydromorphological restoration of running waters: effects on benthic invertebrate assemblages: Benthic invertebrate response to restoration
journal, April 2011
- Sundermann, Andrea; Antons, Claudia; Cron, Nathalie
- Freshwater Biology, Vol. 56, Issue 8
Experimental Evidence on the Value of Trout Stream Improvement in Michigan
journal, January 1937
- Tarzwell, Clarence M.
- Transactions of the American Fisheries Society, Vol. 66, Issue 1
Twenty years of stream restoration in Finland: little response by benthic macroinvertebrate communities
journal, September 2011
- Louhi, Pauliina; Mykrä, Heikki; Paavola, Riku
- Ecological Applications, Vol. 21, Issue 6
Pulsed Monitoring for Watershed and Stream Restoration
journal, November 1995
- Bryant, Mason D.
- Fisheries, Vol. 20, Issue 11
The Economic and Employment Impacts of Forest and Watershed Restoration
journal, July 2012
- Nielsen-Pincus, Max; Moseley, Cassandra
- Restoration Ecology, Vol. 21, Issue 2
Cautions on using the Before-After-Control-Impact design in environmental effects monitoring programs
journal, May 2017
- Smokorowski, K. E.; Randall, R. G.
- FACETS, Vol. 2, Issue 1
Long-term monitoring reveals the success of salmonid habitat restoration
journal, December 2016
- Louhi, Pauliina; Vehanen, Teppo; Huusko, Ari
- Canadian Journal of Fisheries and Aquatic Sciences, Vol. 73, Issue 12
The impact of hydromorphological restoration on river ecological status: a comparison of fish, benthic invertebrates, and macrophytes
journal, July 2012
- Haase, P.; Hering, D.; Jähnig, S. C.
- Hydrobiologia, Vol. 704, Issue 1
Evaluation of Instream Enhancement Structures for Salmonid Spawning and Rearing in a Coastal Oregon Stream
journal, April 1985
- House, Robert A.; Boehne, Paul L.
- North American Journal of Fisheries Management, Vol. 5, Issue 2B
Re-building brown trout populations in dredged boreal forest streams: in-stream restoration combined with stocking of young trout: Re-building brown trout populations
journal, July 2012
- Luhta, Pirkko-Liisa; Huusko, Ari; Louhi, Pauliina
- Freshwater Biology, Vol. 57, Issue 9
ECOLOGY: Synthesizing U.S. River Restoration Efforts
journal, April 2005
- Bernhardt, E. S.
- Science, Vol. 308, Issue 5722
Effectiveness of Habitat Manipulation for Wild Salmonids in Wyoming Streams
journal, August 2004
- Binns, N. Allen
- North American Journal of Fisheries Management, Vol. 24, Issue 3
The Epidemiology of Monitoring1
journal, August 2001
- Reid, Leslie M.
- JAWRA Journal of the American Water Resources Association, Vol. 37, Issue 4
Response of trout populations in five Colorado streams two decades after habitat manipulation
journal, December 2011
- White, Shannon L.; Gowan, Charles; Fausch, Kurt D.
- Canadian Journal of Fisheries and Aquatic Sciences, Vol. 68, Issue 12
A Comparison of the Performance and Compatibility of Protocols Used by Seven Monitoring Groups to Measure Stream Habitat in the Pacific Northwest
journal, April 2010
- Roper, Brett B.; Buffington, John M.; Bennett, Stephen
- North American Journal of Fisheries Management, Vol. 30, Issue 2
Assessing restoration effects on hydromorphology in European mid-sized rivers by key hydromorphological parameters
journal, October 2015
- Poppe, Michaela; Kail, Jochem; Aroviita, Jukka
- Hydrobiologia, Vol. 769, Issue 1
Effects of Natural-Channel-Design Restoration on Habitat Quality in Catskill Mountain Streams, New York
journal, March 2010
- Ernst, Anne G.; Baldigo, Barry P.; Mulvihill, Christiane I.
- Transactions of the American Fisheries Society, Vol. 139, Issue 2
Progress and Challenges of Testing the Effectiveness of Stream Restoration in the Pacific Northwest Using Intensively Monitored Watersheds
journal, January 2016
- Bennett, Stephen; Pess, George; Bouwes, Nicolaas
- Fisheries, Vol. 41, Issue 2
The effect of river restoration on fish, macroinvertebrates and aquatic macrophytes: A meta-analysis
journal, November 2015
- Kail, Jochem; Brabec, Karel; Poppe, Michaela
- Ecological Indicators, Vol. 58
How is success or failure in river restoration projects evaluated? Feedback from French restoration projects
journal, May 2014
- Morandi, Bertrand; Piégay, Hervé; Lamouroux, Nicolas
- Journal of Environmental Management, Vol. 137
A comparative analysis of restoration measures and their effects on hydromorphology and benthic invertebrates in 26 central and southern European rivers: Comparative analysis of river restoration measures
journal, April 2010
- Jähnig, Sonja C.; Brabec, Karel; Buffagni, Andrea
- Journal of Applied Ecology, Vol. 47, Issue 3
On Beyond BACI: Sampling Designs that Might Reliably Detect Environmental Disturbances
journal, February 1994
- Underwood, A. J.
- Ecological Applications, Vol. 4, Issue 1
Response of fish assemblages to hydromorphological restoration in central and northern European rivers
journal, July 2015
- Schmutz, Stefan; Jurajda, Pavel; Kaufmann, Simon
- Hydrobiologia, Vol. 769, Issue 1
Long-Term Demographic Responses of Trout Populations to Habitat Manipulation in Six Colorado Streams
journal, August 1996
- Gowan, Charles; Fausch, Kurt D.
- Ecological Applications, Vol. 6, Issue 3
APPLIED ISSUES: Effects of habitat rehabilitation on brown trout (Salmo trutta) in boreal forest streams: Rehabilitation of forest streams
journal, July 2010
- Vehanen, T.; Huusko, A.; MÄKi-PetÄYs, A.
- Freshwater Biology, Vol. 55, Issue 10
A Long-Term Evaluation of Trout Habitat Development and Its Relation to Improving Management-Related Research
journal, May 1976
- Hunt, Robert L.
- Transactions of the American Fisheries Society, Vol. 105, Issue 3
Experimental Designs for Estimating Transient Responses to Management Disturbances
journal, March 1988
- Walters, Carl J.; Collie, Jeremy S.; Webb, Timothy
- Canadian Journal of Fisheries and Aquatic Sciences, Vol. 45, Issue 3
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
journal, July 2009
- Moher, David; Liberati, Alessandro; Tetzlaff, Jennifer
- PLoS Medicine, Vol. 6, Issue 7
Comparing Stream Restoration Project Effectiveness Using a Programmatic Evaluation of Salmonid Habitat and Fish Response
journal, May 2016
- O’Neal, Jennifer S.; Roni, Phil; Crawford, Bruce
- North American Journal of Fisheries Management, Vol. 36, Issue 3
Effects of an increase in large wood on abundance and survival of juvenile salmonids ( Oncorhynchus spp.) in an Oregon coastal stream
journal, February 2005
- Johnson, Steven L.; Rodgers, Jeffrey D.; Solazzi, Mario F.
- Canadian Journal of Fisheries and Aquatic Sciences, Vol. 62, Issue 2
Juvenile salmonid ( Oncorhynchus spp.) use of constructed and natural side channels in Pacific Northwest rivers
journal, December 2005
- Morley, Sarah A.; Garcia, Patricia S.; Bennett, Todd R.
- Canadian Journal of Fisheries and Aquatic Sciences, Vol. 62, Issue 12
Contrasting the roles of section length and instream habitat enhancement for river restoration success: a field study of 20 European restoration projects
journal, September 2015
- Hering, Daniel; Aroviita, Jukka; Baattrup-Pedersen, Annette
- Journal of Applied Ecology, Vol. 52, Issue 6
Detection of Regional Trends in Salmonid Habitat in Coastal Streams, Oregon
journal, February 2011
- Anlauf, Kara J.; Gaeuman, William; Jones, Kim K.
- Transactions of the American Fisheries Society, Vol. 140, Issue 1
Streambank Restoration Effectiveness: Lessons Learned from a Comparative Study
journal, June 2007
- Cooperman, M. S.; Hinch, S. G.; Bennett, S.
- Fisheries, Vol. 32, Issue 6
Long-term, habitat-specific response of a macroinvertebrate community to river restoration
journal, January 1998
- Friberg, Nikolai; Kronvang, Brian; Ole Hansen, Hans
- Aquatic Conservation: Marine and Freshwater Ecosystems, Vol. 8, Issue 1
Ecological effects of rehabilitation measures at the Austrian Danube: a meta-analysis of fish assemblages
journal, April 2013
- Schmutz, Stefan; Kremser, Helga; Melcher, Andreas
- Hydrobiologia, Vol. 729, Issue 1
Standards for ecologically successful river restoration: Ecological success in river restoration
journal, March 2005
- Palmer, M. A.; Bernhardt, E. S.; Allan, J. D.
- Journal of Applied Ecology, Vol. 42, Issue 2
Estimating the Size and Impact of the Ecological Restoration Economy
journal, June 2015
- BenDor, Todd; Lester, T. William; Livengood, Avery
- PLOS ONE, Vol. 10, Issue 6
Assessment of a catchmentwide salmon habitat rehabilitation scheme on a drained river system in Northern Ireland
journal, May 2014
- Kennedy, R. J.; Johnston, P.; Allen, M.
- Fisheries Management and Ecology, Vol. 21, Issue 4
Detecting persistent change in the habitat of salmon-bearing streams in the Pacific Northwest
journal, February 2004
- Larsen, David P.; Kaufmann, Philip R.; Kincaid, Thomas M.
- Canadian Journal of Fisheries and Aquatic Sciences, Vol. 61, Issue 2
Development of Vegetation and Aquatic Habitat in Restored Riparian Sites of California's North Coast Rangelands
journal, March 2011
- Lennox, Michael S.; Lewis, David J.; Jackson, Randall D.
- Restoration Ecology, Vol. 19, Issue 2
Stream Restoration and Enhancement Projects: Is Anyone Monitoring?
journal, June 2002
- Bash, Jeffrey S.; Ryan, Clare M.
- Environmental Management, Vol. 29, Issue 6
The Use (and Abuse) of Meta-Analysis in Environmental and Natural Resource Economics: An Assessment
journal, December 2008
- Nelson, Jon P.; Kennedy, Peter E.
- Environmental and Resource Economics, Vol. 42, Issue 3
A Review of Stream Restoration Techniques and a Hierarchical Strategy for Prioritizing Restoration in Pacific Northwest Watersheds
journal, February 2002
- Roni, Philip; Beechie, Timothy J.; Bilby, Robert E.
- North American Journal of Fisheries Management, Vol. 22, Issue 1
Goals and principles for programmatic river restoration monitoring and evaluation: collaborative learning across multiple projects: Programmatic river restoration monitoring and evaluation
journal, October 2017
- Weber, Christine; Åberg, Ulrika; Buijse, Anthonie D.
- Wiley Interdisciplinary Reviews: Water, Vol. 5, Issue 1
Five Elements for Effective Evaluation of Stream Restoration
journal, June 1995
- Kondolf, G. Mathias
- Restoration Ecology, Vol. 3, Issue 2
Giants' shoulders 15 years later: lessons, challenges and guidelines in fisheries meta-analysis
journal, October 2013
- Thorson, James T.; Cope, Jason M.; Kleisner, Kristin M.
- Fish and Fisheries, Vol. 16, Issue 2
Structural and functional responses of floodplain vegetation to stream ecosystem restoration
journal, July 2015
- Göthe, Emma; Timmermann, Allan; Januschke, Kathrin
- Hydrobiologia, Vol. 769, Issue 1