DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Accuracy, Bias, and Improvements in Mapping Crops and Cropland across the United States Using the USDA Cropland Data Layer

Abstract

The U.S. Department of Agriculture’s (USDA) Cropland Data Layer (CDL) is a 30 m resolution crop-specific land cover map produced annually to assess crops and cropland area across the conterminous United States. Despite its prominent use and value for monitoring agricultural land use/land cover (LULC), there remains substantial uncertainty surrounding the CDLs’ performance, particularly in applications measuring LULC at national scales, within aggregated classes, or changes across years. To fill this gap, we used state- and land cover class-specific accuracy statistics from the USDA from 2008 to 2016 to comprehensively characterize the performance of the CDL across space and time. We estimated nationwide area-weighted accuracies for the CDL for specific crops as well as for the aggregated classes of cropland and non-cropland. We also derived and reported new metrics of superclass accuracy and within-domain error rates, which help to quantify and differentiate the efficacy of mapping aggregated land use classes (e.g., cropland) among constituent subclasses (i.e., specific crops). We show that aggregate classes embody drastically higher accuracies, such that the CDL correctly identifies cropland from the user’s perspective 97% of the time or greater for all years since nationwide coverage began in 2008. We also quantified the mapping biases ofmore » specific crops throughout time and used these data to generate independent bias-adjusted crop area estimates, which may complement other USDA survey- and census-based crop statistics. Our overall findings demonstrate that the CDLs provide highly accurate annual measures of crops and cropland areas, and when used appropriately, are an indispensable tool for monitoring changes to agricultural landscapes.« less

Authors:
ORCiD logo [1];  [1];  [1]
  1. Univ. of Wisconsin, Madison, WI (United States)
Publication Date:
Research Org.:
Great Lakes Bioenergy Research Center (GLBRC), Madison, WI (United States)
Sponsoring Org.:
USDOE Office of Science (SC), Biological and Environmental Research (BER); National Science Foundation (NSF)
OSTI Identifier:
1776846
Grant/Contract Number:  
SC0018409; DRL-1713110
Resource Type:
Accepted Manuscript
Journal Name:
Remote Sensing
Additional Journal Information:
Journal Volume: 13; Journal Issue: 5; Journal ID: ISSN 2072-4292
Publisher:
MDPI
Country of Publication:
United States
Language:
English
Subject:
54 ENVIRONMENTAL SCIENCES; accuracy assessment; accuracy metrics; map bias; confidence; crop maps; Cropland Data Layer; land use/land cover change; remote sensing products

Citation Formats

Lark, Tyler J., Schelly, Ian H., and Gibbs, Holly K. Accuracy, Bias, and Improvements in Mapping Crops and Cropland across the United States Using the USDA Cropland Data Layer. United States: N. p., 2021. Web. doi:10.3390/rs13050968.
Lark, Tyler J., Schelly, Ian H., & Gibbs, Holly K. Accuracy, Bias, and Improvements in Mapping Crops and Cropland across the United States Using the USDA Cropland Data Layer. United States. https://doi.org/10.3390/rs13050968
Lark, Tyler J., Schelly, Ian H., and Gibbs, Holly K. Thu . "Accuracy, Bias, and Improvements in Mapping Crops and Cropland across the United States Using the USDA Cropland Data Layer". United States. https://doi.org/10.3390/rs13050968. https://www.osti.gov/servlets/purl/1776846.
@article{osti_1776846,
title = {Accuracy, Bias, and Improvements in Mapping Crops and Cropland across the United States Using the USDA Cropland Data Layer},
author = {Lark, Tyler J. and Schelly, Ian H. and Gibbs, Holly K.},
abstractNote = {The U.S. Department of Agriculture’s (USDA) Cropland Data Layer (CDL) is a 30 m resolution crop-specific land cover map produced annually to assess crops and cropland area across the conterminous United States. Despite its prominent use and value for monitoring agricultural land use/land cover (LULC), there remains substantial uncertainty surrounding the CDLs’ performance, particularly in applications measuring LULC at national scales, within aggregated classes, or changes across years. To fill this gap, we used state- and land cover class-specific accuracy statistics from the USDA from 2008 to 2016 to comprehensively characterize the performance of the CDL across space and time. We estimated nationwide area-weighted accuracies for the CDL for specific crops as well as for the aggregated classes of cropland and non-cropland. We also derived and reported new metrics of superclass accuracy and within-domain error rates, which help to quantify and differentiate the efficacy of mapping aggregated land use classes (e.g., cropland) among constituent subclasses (i.e., specific crops). We show that aggregate classes embody drastically higher accuracies, such that the CDL correctly identifies cropland from the user’s perspective 97% of the time or greater for all years since nationwide coverage began in 2008. We also quantified the mapping biases of specific crops throughout time and used these data to generate independent bias-adjusted crop area estimates, which may complement other USDA survey- and census-based crop statistics. Our overall findings demonstrate that the CDLs provide highly accurate annual measures of crops and cropland areas, and when used appropriately, are an indispensable tool for monitoring changes to agricultural landscapes.},
doi = {10.3390/rs13050968},
journal = {Remote Sensing},
number = 5,
volume = 13,
place = {United States},
year = {Thu Mar 04 00:00:00 EST 2021},
month = {Thu Mar 04 00:00:00 EST 2021}
}

Works referenced in this record:

The emergence of land change science for global environmental change and sustainability
journal, December 2007

  • Turner, B. L.; Lambin, E. F.; Reenberg, A.
  • Proceedings of the National Academy of Sciences, Vol. 104, Issue 52
  • DOI: 10.1073/pnas.0704119104

Crop classification modelling using remote sensing and environmental data in the Greater Platte River Basin, USA
journal, April 2012

  • Howard, Daniel M.; Wylie, Bruce K.; Tieszen, Larry L.
  • International Journal of Remote Sensing, Vol. 33, Issue 19
  • DOI: 10.1080/01431161.2012.680617

CropScape: A Web service based application for exploring and disseminating US conterminous geospatial cropland data products for decision support
journal, June 2012


Complying with conservation compliance? An assessment of recent evidence in the US Corn Belt
journal, August 2020

  • Holland, Austin; Bennett, David; Secchi, Silvia
  • Environmental Research Letters, Vol. 15, Issue 8
  • DOI: 10.1088/1748-9326/ab8f60

Making better use of accuracy data in land change studies: Estimating accuracy and area and quantifying uncertainty using stratified estimation
journal, February 2013

  • Olofsson, Pontus; Foody, Giles M.; Stehman, Stephen V.
  • Remote Sensing of Environment, Vol. 129
  • DOI: 10.1016/j.rse.2012.10.031

Trends in Remote Sensing Accuracy Assessment Approaches in the Context of Natural Resources
journal, October 2019

  • Morales-Barquero, Lucia; Lyons, Mitchell; Phinn, Stuart
  • Remote Sensing, Vol. 11, Issue 19
  • DOI: 10.3390/rs11192305

Key issues in rigorous accuracy assessment of land cover products
journal, September 2019


Monitoring US agriculture: the US Department of Agriculture, National Agricultural Statistics Service, Cropland Data Layer Program
journal, August 2011


A 2010 map estimate of annually tilled cropland within the conterminous United States
journal, January 2013


Changes of crop rotation in Iowa determined from the United States Department of Agriculture, National Agricultural Statistics Service cropland data layer product
journal, January 2012

  • Stern, Alan J.; Doraiswamy, Paul C.; Raymond Hunt, E.
  • Journal of Applied Remote Sensing, Vol. 6, Issue 1
  • DOI: 10.1117/1.JRS.6.063590

Identifying representative crop rotation patterns and grassland loss in the US Western Corn Belt
journal, October 2014

  • Sahajpal, Ritvik; Zhang, Xuesong; Izaurralde, Roberto C.
  • Computers and Electronics in Agriculture, Vol. 108
  • DOI: 10.1016/j.compag.2014.08.005

Evidence for increased monoculture cropping in the Central United States
journal, January 2013

  • Plourde, James D.; Pijanowski, Bryan C.; Pekin, Burak K.
  • Agriculture, Ecosystems & Environment, Vol. 165
  • DOI: 10.1016/j.agee.2012.11.011

The environmental effects of crop price increases: Nitrogen losses in the U.S. Corn Belt
journal, November 2014

  • Hendricks, Nathan P.; Sinnathamby, Sumathy; Douglas-Mankin, Kyle
  • Journal of Environmental Economics and Management, Vol. 68, Issue 3
  • DOI: 10.1016/j.jeem.2014.09.002

Cropland expansion outpaces agricultural and biofuel policies in the United States
journal, April 2015


Perennial grasslands enhance biodiversity and multiple ecosystem services in bioenergy landscapes
journal, January 2014

  • Werling, B. P.; Dickson, T. L.; Isaacs, R.
  • Proceedings of the National Academy of Sciences, Vol. 111, Issue 4
  • DOI: 10.1073/pnas.1309492111

Ecosystem-Service Tradeoffs Associated with Switching from Annual to Perennial Energy Crops in Riparian Zones of the US Midwest
journal, November 2013


Thematic accuracy of the NLCD 2001 land cover for the conterminous United States
journal, June 2010


Reply to Kline et al.: Cropland data layer provides a valid assessment of recent grassland conversion in the Western Corn Belt
journal, June 2013

  • Wright, C. K.; Wimberly, M. C.
  • Proceedings of the National Academy of Sciences, Vol. 110, Issue 31
  • DOI: 10.1073/pnas.1307594110

Recent Land Use Change to Agriculture in the U.S. Lake States: Impacts on Cellulosic Biomass Potential and Natural Lands
journal, February 2016


Plowprint: Tracking Cumulative Cropland Expansion to Target Grassland Conservation
journal, January 2016

  • Gage, Anne M.; Olimb, Sarah K.; Nelson, Jeff
  • Great Plains Research, Vol. 26, Issue 2
  • DOI: 10.1353/gpr.2016.0019

Wetland Losses Due to Row Crop Expansion in the Dakota Prairie Pothole Region
journal, January 2013


Cropland expansion in the United States produces marginal yields at high costs to wildlife
journal, September 2020


Measured extent of agricultural expansion depends on analysis technique
journal, January 2017

  • Dunn, Jennifer B.; Merz, Dylan; Copenhaver, Ken L.
  • Biofuels, Bioproducts and Biorefining, Vol. 11, Issue 2
  • DOI: 10.1002/bbb.1750

Measuring Cropland Change: A Cautionary Tale
journal, January 2015


Taken as a given: Evaluating the accuracy of remotely sensed crop data in the USA
journal, December 2015


Biofuel impact on food prices index and land use change
journal, May 2019


Cultivated hay and fallow/idle cropland confound analysis of grassland conversion in the Western Corn Belt
journal, June 2013

  • Kline, K. L.; Singh, N.; Dale, V. H.
  • Proceedings of the National Academy of Sciences, Vol. 110, Issue 31
  • DOI: 10.1073/pnas.1306646110

Measuring land-use and land-cover change using the U.S. department of agriculture’s cropland data layer: Cautions and recommendations
journal, October 2017

  • Lark, Tyler J.; Mueller, Richard M.; Johnson, David M.
  • International Journal of Applied Earth Observation and Geoinformation, Vol. 62
  • DOI: 10.1016/j.jag.2017.06.007

Modeling Grassland Conversion: Challenges of Using Satellite Imagery Data
journal, December 2012

  • Rashford, Benjamin S.; Albeke, Shannon E.; Lewis, David J.
  • American Journal of Agricultural Economics, Vol. 95, Issue 2
  • DOI: 10.1093/ajae/aas110

Uncertainty and Confidence in Land Cover Classification Using a Hybrid Classifier Approach
journal, August 2004

  • Liu, Weiguo; Gopal, Sucharita; Woodcock, Curtis E.
  • Photogrammetric Engineering & Remote Sensing, Vol. 70, Issue 8
  • DOI: 10.14358/PERS.70.8.963

Change Vector Analysis in Posterior Probability Space: A New Method for Land Cover Change Detection
journal, March 2011

  • Chen, Jin; Chen, Xuehong; Cui, Xihong
  • IEEE Geoscience and Remote Sensing Letters, Vol. 8, Issue 2
  • DOI: 10.1109/LGRS.2010.2068537

Estimating area from an accuracy assessment error matrix
journal, May 2013


Good practices for estimating area and assessing accuracy of land change
journal, May 2014


Agricultural expansion: land use shell game in the U.S. Northern Plains
journal, October 2013


Grasslands, wetlands, and agriculture: the fate of land expiring from the Conservation Reserve Program in the Midwestern United States
journal, August 2016

  • Morefield, Philip E.; LeDuc, Stephen D.; Clark, Christopher M.
  • Environmental Research Letters, Vol. 11, Issue 9
  • DOI: 10.1088/1748-9326/11/9/094005

Crop Supply Dynamics and the Illusion of Partial Adjustment
journal, May 2014

  • Hendricks, Nathan P.; Smith, Aaron; Sumner, Daniel A.
  • American Journal of Agricultural Economics, Vol. 96, Issue 5
  • DOI: 10.1093/ajae/aau024

Accelerated Conversion of Native Prairie to Cropland in Minnesota
journal, December 2018


National-scale soybean mapping and area estimation in the United States using medium resolution satellite imagery and field survey
journal, March 2017

  • Song, Xiao-Peng; Potapov, Peter V.; Krylov, Alexander
  • Remote Sensing of Environment, Vol. 190
  • DOI: 10.1016/j.rse.2017.01.008