Accuracy, Bias, and Improvements in Mapping Crops and Cropland across the United States Using the USDA Cropland Data Layer
Abstract
The U.S. Department of Agriculture’s (USDA) Cropland Data Layer (CDL) is a 30 m resolution crop-specific land cover map produced annually to assess crops and cropland area across the conterminous United States. Despite its prominent use and value for monitoring agricultural land use/land cover (LULC), there remains substantial uncertainty surrounding the CDLs’ performance, particularly in applications measuring LULC at national scales, within aggregated classes, or changes across years. To fill this gap, we used state- and land cover class-specific accuracy statistics from the USDA from 2008 to 2016 to comprehensively characterize the performance of the CDL across space and time. We estimated nationwide area-weighted accuracies for the CDL for specific crops as well as for the aggregated classes of cropland and non-cropland. We also derived and reported new metrics of superclass accuracy and within-domain error rates, which help to quantify and differentiate the efficacy of mapping aggregated land use classes (e.g., cropland) among constituent subclasses (i.e., specific crops). We show that aggregate classes embody drastically higher accuracies, such that the CDL correctly identifies cropland from the user’s perspective 97% of the time or greater for all years since nationwide coverage began in 2008. We also quantified the mapping biases ofmore »
- Authors:
-
- Univ. of Wisconsin, Madison, WI (United States)
- Publication Date:
- Research Org.:
- Great Lakes Bioenergy Research Center (GLBRC), Madison, WI (United States)
- Sponsoring Org.:
- USDOE Office of Science (SC), Biological and Environmental Research (BER); National Science Foundation (NSF)
- OSTI Identifier:
- 1776846
- Grant/Contract Number:
- SC0018409; DRL-1713110
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Remote Sensing
- Additional Journal Information:
- Journal Volume: 13; Journal Issue: 5; Journal ID: ISSN 2072-4292
- Publisher:
- MDPI
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 54 ENVIRONMENTAL SCIENCES; accuracy assessment; accuracy metrics; map bias; confidence; crop maps; Cropland Data Layer; land use/land cover change; remote sensing products
Citation Formats
Lark, Tyler J., Schelly, Ian H., and Gibbs, Holly K. Accuracy, Bias, and Improvements in Mapping Crops and Cropland across the United States Using the USDA Cropland Data Layer. United States: N. p., 2021.
Web. doi:10.3390/rs13050968.
Lark, Tyler J., Schelly, Ian H., & Gibbs, Holly K. Accuracy, Bias, and Improvements in Mapping Crops and Cropland across the United States Using the USDA Cropland Data Layer. United States. https://doi.org/10.3390/rs13050968
Lark, Tyler J., Schelly, Ian H., and Gibbs, Holly K. Thu .
"Accuracy, Bias, and Improvements in Mapping Crops and Cropland across the United States Using the USDA Cropland Data Layer". United States. https://doi.org/10.3390/rs13050968. https://www.osti.gov/servlets/purl/1776846.
@article{osti_1776846,
title = {Accuracy, Bias, and Improvements in Mapping Crops and Cropland across the United States Using the USDA Cropland Data Layer},
author = {Lark, Tyler J. and Schelly, Ian H. and Gibbs, Holly K.},
abstractNote = {The U.S. Department of Agriculture’s (USDA) Cropland Data Layer (CDL) is a 30 m resolution crop-specific land cover map produced annually to assess crops and cropland area across the conterminous United States. Despite its prominent use and value for monitoring agricultural land use/land cover (LULC), there remains substantial uncertainty surrounding the CDLs’ performance, particularly in applications measuring LULC at national scales, within aggregated classes, or changes across years. To fill this gap, we used state- and land cover class-specific accuracy statistics from the USDA from 2008 to 2016 to comprehensively characterize the performance of the CDL across space and time. We estimated nationwide area-weighted accuracies for the CDL for specific crops as well as for the aggregated classes of cropland and non-cropland. We also derived and reported new metrics of superclass accuracy and within-domain error rates, which help to quantify and differentiate the efficacy of mapping aggregated land use classes (e.g., cropland) among constituent subclasses (i.e., specific crops). We show that aggregate classes embody drastically higher accuracies, such that the CDL correctly identifies cropland from the user’s perspective 97% of the time or greater for all years since nationwide coverage began in 2008. We also quantified the mapping biases of specific crops throughout time and used these data to generate independent bias-adjusted crop area estimates, which may complement other USDA survey- and census-based crop statistics. Our overall findings demonstrate that the CDLs provide highly accurate annual measures of crops and cropland areas, and when used appropriately, are an indispensable tool for monitoring changes to agricultural landscapes.},
doi = {10.3390/rs13050968},
journal = {Remote Sensing},
number = 5,
volume = 13,
place = {United States},
year = {Thu Mar 04 00:00:00 EST 2021},
month = {Thu Mar 04 00:00:00 EST 2021}
}
Works referenced in this record:
The emergence of land change science for global environmental change and sustainability
journal, December 2007
- Turner, B. L.; Lambin, E. F.; Reenberg, A.
- Proceedings of the National Academy of Sciences, Vol. 104, Issue 52
Crop classification modelling using remote sensing and environmental data in the Greater Platte River Basin, USA
journal, April 2012
- Howard, Daniel M.; Wylie, Bruce K.; Tieszen, Larry L.
- International Journal of Remote Sensing, Vol. 33, Issue 19
Evaluating forest conservation policies in developing countries using remote sensing data: An introduction and practical guide
journal, September 2013
- Blackman, Allen
- Forest Policy and Economics, Vol. 34
Protecting our prairies: Research and policy actions for conserving America’s grasslands
journal, September 2020
- Lark, Tyler J.
- Land Use Policy, Vol. 97
CropScape: A Web service based application for exploring and disseminating US conterminous geospatial cropland data products for decision support
journal, June 2012
- Han, Weiguo; Yang, Zhengwei; Di, Liping
- Computers and Electronics in Agriculture, Vol. 84
Complying with conservation compliance? An assessment of recent evidence in the US Corn Belt
journal, August 2020
- Holland, Austin; Bennett, David; Secchi, Silvia
- Environmental Research Letters, Vol. 15, Issue 8
Valuing map validation: The need for rigorous land cover map accuracy assessment in economic valuations of ecosystem services
journal, March 2015
- Foody, G. M.
- Ecological Economics, Vol. 111
Making better use of accuracy data in land change studies: Estimating accuracy and area and quantifying uncertainty using stratified estimation
journal, February 2013
- Olofsson, Pontus; Foody, Giles M.; Stehman, Stephen V.
- Remote Sensing of Environment, Vol. 129
Trends in Remote Sensing Accuracy Assessment Approaches in the Context of Natural Resources
journal, October 2019
- Morales-Barquero, Lucia; Lyons, Mitchell; Phinn, Stuart
- Remote Sensing, Vol. 11, Issue 19
Key issues in rigorous accuracy assessment of land cover products
journal, September 2019
- Stehman, Stephen V.; Foody, Giles M.
- Remote Sensing of Environment, Vol. 231
Monitoring US agriculture: the US Department of Agriculture, National Agricultural Statistics Service, Cropland Data Layer Program
journal, August 2011
- Boryan, Claire; Yang, Zhengwei; Mueller, Rick
- Geocarto International, Vol. 26, Issue 5
A 2010 map estimate of annually tilled cropland within the conterminous United States
journal, January 2013
- Johnson, David M.
- Agricultural Systems, Vol. 114
Changes of crop rotation in Iowa determined from the United States Department of Agriculture, National Agricultural Statistics Service cropland data layer product
journal, January 2012
- Stern, Alan J.; Doraiswamy, Paul C.; Raymond Hunt, E.
- Journal of Applied Remote Sensing, Vol. 6, Issue 1
Identifying representative crop rotation patterns and grassland loss in the US Western Corn Belt
journal, October 2014
- Sahajpal, Ritvik; Zhang, Xuesong; Izaurralde, Roberto C.
- Computers and Electronics in Agriculture, Vol. 108
Evidence for increased monoculture cropping in the Central United States
journal, January 2013
- Plourde, James D.; Pijanowski, Bryan C.; Pekin, Burak K.
- Agriculture, Ecosystems & Environment, Vol. 165
The environmental effects of crop price increases: Nitrogen losses in the U.S. Corn Belt
journal, November 2014
- Hendricks, Nathan P.; Sinnathamby, Sumathy; Douglas-Mankin, Kyle
- Journal of Environmental Economics and Management, Vol. 68, Issue 3
Cropland expansion outpaces agricultural and biofuel policies in the United States
journal, April 2015
- Lark, Tyler J.; Meghan Salmon, J.; Gibbs, Holly K.
- Environmental Research Letters, Vol. 10, Issue 4
Perennial grasslands enhance biodiversity and multiple ecosystem services in bioenergy landscapes
journal, January 2014
- Werling, B. P.; Dickson, T. L.; Isaacs, R.
- Proceedings of the National Academy of Sciences, Vol. 111, Issue 4
Ecosystem-Service Tradeoffs Associated with Switching from Annual to Perennial Energy Crops in Riparian Zones of the US Midwest
journal, November 2013
- Meehan, Timothy D.; Gratton, Claudio; Diehl, Erica
- PLoS ONE, Vol. 8, Issue 11
Thematic accuracy of the NLCD 2001 land cover for the conterminous United States
journal, June 2010
- Wickham, J. D.; Stehman, S. V.; Fry, J. A.
- Remote Sensing of Environment, Vol. 114, Issue 6
Reply to Kline et al.: Cropland data layer provides a valid assessment of recent grassland conversion in the Western Corn Belt
journal, June 2013
- Wright, C. K.; Wimberly, M. C.
- Proceedings of the National Academy of Sciences, Vol. 110, Issue 31
Recent Land Use Change to Agriculture in the U.S. Lake States: Impacts on Cellulosic Biomass Potential and Natural Lands
journal, February 2016
- Mladenoff, David J.; Sahajpal, Ritvik; Johnson, Christopher P.
- PLOS ONE, Vol. 11, Issue 2
Plowprint: Tracking Cumulative Cropland Expansion to Target Grassland Conservation
journal, January 2016
- Gage, Anne M.; Olimb, Sarah K.; Nelson, Jeff
- Great Plains Research, Vol. 26, Issue 2
Wetland Losses Due to Row Crop Expansion in the Dakota Prairie Pothole Region
journal, January 2013
- Johnston, Carol A.
- Wetlands, Vol. 33, Issue 1
Cropland expansion in the United States produces marginal yields at high costs to wildlife
journal, September 2020
- Lark, Tyler J.; Spawn, Seth A.; Bougie, Matthew
- Nature Communications, Vol. 11, Issue 1
Measured extent of agricultural expansion depends on analysis technique
journal, January 2017
- Dunn, Jennifer B.; Merz, Dylan; Copenhaver, Ken L.
- Biofuels, Bioproducts and Biorefining, Vol. 11, Issue 2
Measuring Cropland Change: A Cautionary Tale
journal, January 2015
- Laingen, Chris
- Papers in Applied Geography, Vol. 1, Issue 1
Taken as a given: Evaluating the accuracy of remotely sensed crop data in the USA
journal, December 2015
- Larsen, Ashley E.; Hendrickson, Brandon T.; Dedeic, Nicholas
- Agricultural Systems, Vol. 141
Biofuel impact on food prices index and land use change
journal, May 2019
- Shrestha, D. S.; Staab, B. D.; Duffield, J. A.
- Biomass and Bioenergy, Vol. 124
Cultivated hay and fallow/idle cropland confound analysis of grassland conversion in the Western Corn Belt
journal, June 2013
- Kline, K. L.; Singh, N.; Dale, V. H.
- Proceedings of the National Academy of Sciences, Vol. 110, Issue 31
Measuring land-use and land-cover change using the U.S. department of agriculture’s cropland data layer: Cautions and recommendations
journal, October 2017
- Lark, Tyler J.; Mueller, Richard M.; Johnson, David M.
- International Journal of Applied Earth Observation and Geoinformation, Vol. 62
Modeling Grassland Conversion: Challenges of Using Satellite Imagery Data
journal, December 2012
- Rashford, Benjamin S.; Albeke, Shannon E.; Lewis, David J.
- American Journal of Agricultural Economics, Vol. 95, Issue 2
Uncertainty and Confidence in Land Cover Classification Using a Hybrid Classifier Approach
journal, August 2004
- Liu, Weiguo; Gopal, Sucharita; Woodcock, Curtis E.
- Photogrammetric Engineering & Remote Sensing, Vol. 70, Issue 8
Change Vector Analysis in Posterior Probability Space: A New Method for Land Cover Change Detection
journal, March 2011
- Chen, Jin; Chen, Xuehong; Cui, Xihong
- IEEE Geoscience and Remote Sensing Letters, Vol. 8, Issue 2
Estimating area from an accuracy assessment error matrix
journal, May 2013
- Stehman, Stephen V.
- Remote Sensing of Environment, Vol. 132
Good practices for estimating area and assessing accuracy of land change
journal, May 2014
- Olofsson, Pontus; Foody, Giles M.; Herold, Martin
- Remote Sensing of Environment, Vol. 148
Agricultural expansion: land use shell game in the U.S. Northern Plains
journal, October 2013
- Johnston, Carol A.
- Landscape Ecology, Vol. 29, Issue 1
Development and Applications of a Comprehensive Land Use Classification and Map for the US
journal, April 2014
- Theobald, David M.
- PLoS ONE, Vol. 9, Issue 4
Grasslands, wetlands, and agriculture: the fate of land expiring from the Conservation Reserve Program in the Midwestern United States
journal, August 2016
- Morefield, Philip E.; LeDuc, Stephen D.; Clark, Christopher M.
- Environmental Research Letters, Vol. 11, Issue 9
Crop Supply Dynamics and the Illusion of Partial Adjustment
journal, May 2014
- Hendricks, Nathan P.; Smith, Aaron; Sumner, Daniel A.
- American Journal of Agricultural Economics, Vol. 96, Issue 5
Accelerated Conversion of Native Prairie to Cropland in Minnesota
journal, December 2018
- Lark, Tyler J.; Larson, Ben; Schelly, Ian
- Environmental Conservation, Vol. 46, Issue 2
National-scale soybean mapping and area estimation in the United States using medium resolution satellite imagery and field survey
journal, March 2017
- Song, Xiao-Peng; Potapov, Peter V.; Krylov, Alexander
- Remote Sensing of Environment, Vol. 190