skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Independent review of estimated load reductions for PJM's small customer load response pilot project

Abstract

This study describes the results of a low-cost approach used to measure reported load reductions from a residential electric water heater (EWH) load control program operated as part of PJM Interconnection's Demand Response small customer pilot program. Lawrence Berkeley National Laboratory (LBNL) conducted this independent review of the engineering estimates for EWH load control reported by a Curtailment Service Provider (CSP) at PJM's request. LBNL employed low-cost measurement and verification (M&V) approaches that utilized existing interval metering equipment to monitor results for a series of load control tests. The CSP collected hourly load data for two substations and several hundred households over a six-week period in October and November 2003. During this time period, the CSP operated its electric water heater load control program during pre-specified test periods in the morning, afternoon and early evening. LBNL then analyzed substation and premise-level data from these tests in order to verify the diversified demand reductions claimed by the CSP for customers participating in the EWH load control program. We found that the observed load reductions for the premise-level data aggregated over all households in the two participating electric cooperatives were, respectively, 40 percent-60 percent less and 3 percent less-10 percent higher thanmore » the estimated diversified demand reduction values assumed by the CSP, depending on whether observed or normalized results are considered. We also analyzed sub-station level data and found that the observed load reductions during the test periods were significantly lower than expected, although confounding influences and operational problems signifiogram during pre-specified test periods in the morning, afternoon and early evening. LBNL then analyzed substation and premise-level data from these tests in order to verify the diversified demand reductions claimed by the CSP for customers participating in the EWH load control program. We found that the observed load reductions for the premise-level data aggregated over all households in the two participating electric cooperatives were, respectively, 40 percent-60 percent less and 3 percent less-10 percent higher than the estimated diversified demand reduction values assumed by the CSP, depending on whether observed or normalized results are considered. We also analyzed sub-station level data and found that the observed load reductions during the test periods were significantly lower than expected, although confounding influences and operational problems significantly limit our ability to differentiate between control-related and non-control related differences in substation-level load shape data. The usefulness and accuracy of the results were hampered by operational problems encountered during the measurement period as well as in sufficient number of load research grade interval meters at one cooperative. Given the larger sample size at one electric cooperative and more statistically-robust results, there is some basis to suggest that the Adjusted Diversified Demand Factor (ADDF) values used by the CSP somewhat over-state the actual load reductions. Given the results and limitations of the M&V approach as implemented, we suggest several options for PJM to consider: (1) require load aggregators participating in ISODR programs to utilize formal PURPA-compliant load research samples in their M&V plans, and (2) continue developing lower cost M&V approaches for mass market load control programs that incorporate suggested improvements described in this study.« less

Authors:
; ;
Publication Date:
Research Org.:
Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
Sponsoring Org.:
USDOE. Office of Electric Transmission and Distribution. Electric Markets Technical Assistance Program (US)
OSTI Identifier:
834498
Report Number(s):
LBNL-54835
R&D Project: 673151; TRN: US200432%%366
DOE Contract Number:
AC03-76SF00098
Resource Type:
Technical Report
Resource Relation:
Other Information: PBD: 1 Jun 2004
Country of Publication:
United States
Language:
English
Subject:
29 ENERGY PLANNING, POLICY AND ECONOMY; ACCURACY; COOPERATIVES; DEMAND FACTORS; ELECTRIC UTILITIES; HOUSEHOLDS; MARKET; METERING; METERS; MONITORS; SHAPE; VERIFICATION; WATER HEATERS; CUSTOMER LOAD RESPONSE

Citation Formats

Heffner, G., Moezzi, M., and Goldman, C.. Independent review of estimated load reductions for PJM's small customer load response pilot project. United States: N. p., 2004. Web. doi:10.2172/834498.
Heffner, G., Moezzi, M., & Goldman, C.. Independent review of estimated load reductions for PJM's small customer load response pilot project. United States. doi:10.2172/834498.
Heffner, G., Moezzi, M., and Goldman, C.. Tue . "Independent review of estimated load reductions for PJM's small customer load response pilot project". United States. doi:10.2172/834498. https://www.osti.gov/servlets/purl/834498.
@article{osti_834498,
title = {Independent review of estimated load reductions for PJM's small customer load response pilot project},
author = {Heffner, G. and Moezzi, M. and Goldman, C.},
abstractNote = {This study describes the results of a low-cost approach used to measure reported load reductions from a residential electric water heater (EWH) load control program operated as part of PJM Interconnection's Demand Response small customer pilot program. Lawrence Berkeley National Laboratory (LBNL) conducted this independent review of the engineering estimates for EWH load control reported by a Curtailment Service Provider (CSP) at PJM's request. LBNL employed low-cost measurement and verification (M&V) approaches that utilized existing interval metering equipment to monitor results for a series of load control tests. The CSP collected hourly load data for two substations and several hundred households over a six-week period in October and November 2003. During this time period, the CSP operated its electric water heater load control program during pre-specified test periods in the morning, afternoon and early evening. LBNL then analyzed substation and premise-level data from these tests in order to verify the diversified demand reductions claimed by the CSP for customers participating in the EWH load control program. We found that the observed load reductions for the premise-level data aggregated over all households in the two participating electric cooperatives were, respectively, 40 percent-60 percent less and 3 percent less-10 percent higher than the estimated diversified demand reduction values assumed by the CSP, depending on whether observed or normalized results are considered. We also analyzed sub-station level data and found that the observed load reductions during the test periods were significantly lower than expected, although confounding influences and operational problems signifiogram during pre-specified test periods in the morning, afternoon and early evening. LBNL then analyzed substation and premise-level data from these tests in order to verify the diversified demand reductions claimed by the CSP for customers participating in the EWH load control program. We found that the observed load reductions for the premise-level data aggregated over all households in the two participating electric cooperatives were, respectively, 40 percent-60 percent less and 3 percent less-10 percent higher than the estimated diversified demand reduction values assumed by the CSP, depending on whether observed or normalized results are considered. We also analyzed sub-station level data and found that the observed load reductions during the test periods were significantly lower than expected, although confounding influences and operational problems significantly limit our ability to differentiate between control-related and non-control related differences in substation-level load shape data. The usefulness and accuracy of the results were hampered by operational problems encountered during the measurement period as well as in sufficient number of load research grade interval meters at one cooperative. Given the larger sample size at one electric cooperative and more statistically-robust results, there is some basis to suggest that the Adjusted Diversified Demand Factor (ADDF) values used by the CSP somewhat over-state the actual load reductions. Given the results and limitations of the M&V approach as implemented, we suggest several options for PJM to consider: (1) require load aggregators participating in ISODR programs to utilize formal PURPA-compliant load research samples in their M&V plans, and (2) continue developing lower cost M&V approaches for mass market load control programs that incorporate suggested improvements described in this study.},
doi = {10.2172/834498},
journal = {},
number = ,
volume = ,
place = {United States},
year = {Tue Jun 01 00:00:00 EDT 2004},
month = {Tue Jun 01 00:00:00 EDT 2004}
}

Technical Report:

Save / Share:
  • Based on Technical Support Contractor (TSC) preparation and/or comprehensive review of all elements of the WIPP Project Cost Estimate, TSC proposes that $465.4 million be used as the WIPP Total Estimaed Cost (TEC). The basis for this recommendation is described in Section 3.0 of this report. For the direct and indirect cost elements, which includes 52% of the total TEC, it should be noted that the TSC cost review indicates that the Bechtel detailed cost estimate is considered to be reasonable. There are, of course, items in the maze of detail where, in the opinion of TSC estimators, the costmore » should be different. However, taking the Bechtel cost estimate in total, the TSC recommendation is to use the Bechtel estimate for direct and indirect elements. The relationship of the major cost elements and of the direct and indirect costs are tabulated.« less
  • Recurring electricity shortages and rolling blackouts were widely forecasted for summer 2001 in California. Despite these predictions, blackouts were never ordered - in large part, due to the dramatic reductions in electricity use throughout the state. Compared to summer 2000, Californians reduced electricity usage by 6 percent and average monthly peak demand by 8 percent. Our analysis suggests that these reductions were not caused by either the weather or the downturn in the state's economy; rather, they were the result of extraordinary efforts by Californians to reduce electricity consumption. Based on the California Independent System Operator's (CAISO) available operating reservemore » margin during summer 2001, we estimate that the peak load reductions, which ranged between 3,200 and 5,600 MW in the four summer months, potentially avoided between 50 and 160 hours of rolling blackouts. This extraordinary response by Californians can be attributed to several factors including media coverage and informational campaigns that affected public awareness and understanding, real and/or perceived increases in electricity rates, and various policies and programs deployed by state policymakers and regulators to facilitate customer load reductions. Among these programs, we review the state's 20/20 rebate program, the utilities' energy efficiency programs, programs or initiatives implemented by the California Energy Commission and other state agencies, and load management and demand response programs offered by the state's investor-owned electric utilities and the CAISO. We estimate that energy efficiency and onsite generation projects that were initiated in 2001 will account for about 1,100 MW of customer load reductions, once all projects are installed. These savings represent about 25-30 percent of the observed load reductions and are likely to persist for many years. The persistence of the remaining savings, which were due to changes that customers made in their conservation behavior and energy management operations, will be heavily influenced by customers' perception of continuing electricity crises or significant energy problems and price sensitivity to retail rate trends. The State's current demand response (DR) capability enrolled in utility or CAISO programs is somewhat lower than prior to the crisis. However, in the long run, enabling technologies for demand response deployed through the CEC's Demand Responsive Buildings and Real-time Metering programs have the potential to significantly increase demand response capability. While unique factors led to the electricity crisis in California, we believe the lessons learned from electricity customers' response may be useful for other regions faced with the prospect of electricity shortages. During a short-term crisis, a comprehensive set of load reduction programs and policies can make a significant contribution towards maintaining electric system reliability and can be an effective alternative to strategies that rely solely on rationing demand (e.g. rolling blackouts) or dramatic price increases. Information from various media sources contributed to very high customer awareness of the electricity crisis and helped spur customers to take actions to reduce their electricity usage. Customers viewed the media as an important, and in many cases, trusted information source, which appears to have increased their receptivity to participating in various State and utility initiatives. A commitment to ratepayer-funded energy efficiency programs and energy efficiency standards for appliances and buildings are critical elements of a long-term strategy to dampen growth in electricity demand. California's energy efficiency services delivery infrastructure, which was strengthened by years of ratepayer and State-funded programs, represents a significant resource that was ramped up quickly to respond to a short-term energy emergency.« less
  • The 2009 Participating Load Pilot Customer Impact Evaluation provides evidence that short duration demand response events which cycle off air conditioners for less than thirty minutes in a hot, dry environment do not lead to a significant degradation in the comfort level of residents participating in the program. This was investigated using: (1) Analysis of interval temperature data collected from inside residences of select program participants; and (2) Direct and indirect customer feedback from surveys designed and implemented by Southern California Edison at the conclusion of the program season. There were 100 indoor temperature monitors that were acquired by LBNLmore » for this study that transmitted temperature readings at least once per hour with corresponding timestamps during the program season, June-October, 2009. Recorded temperatures were transferred from the onsite telemetry devices to a mesh network, stored, and then delivered to KEMA for analysis. Following an extensive data quality review, temperature increases during each of the thirty demand response test events were calculated for each device. The results are as follows: (1) Even for tests taking place during outside temperatures in excess of 100 degrees Fahrenheit, over 85 percent of the devices measured less than a 0.5 degree Fahrenheit temperature increase indoors during the duration of the event. (2) For the increases that were observed, none was more than 5 degrees and it was extremely rare for increases to be more than 2 degrees. At the end of the testing season SCE and KEMA designed and conducted a survey of the a facilities and public works managers and approximately 100 customers feedback survey to assess the extent the PLP events were noticed or disrupted the comfort level of participants. While only a small sampling of 3 managers and 16 customer surveys were completed, their responses indicate: (1) No customer reported even a moderate level of discomfort from the cycling-off of their air conditioners during test events; and (2) Very few customers noticed any of the thirty events at all. The results of this study suggest that the impacts on comfort from short-duration interruptions of air-conditioners, even in very hot climates, are for the most part very modest, if they are even noticed at all. Still, we should expect that these impacts will increase with longer interruptions of air-conditioning. By the same token, we should also expect that they will be less significant in cooler climates.« less
  • This report is a response to the findings and recommendations contained in the ITR report. The text of this document summarizes each ITR finding and recommendation, presents the TAC response, and concludes that implementation of many of the recommendations would benefit the UMTRA Project. Implementation of the recommendations represents ongoing improvement to the TAC well installation and development procedures and will result, in lower overall project costs. Appendix B is an implementation plan that groups similar or complementary action items, provides a schedule for implementation, identifies the group or people responsible for the changes, and estimates hours to implement themore » changes. The four major action items are as follows: (1) ITR Reevaluation, (2) Well Installation SOP Review and Revision, (3) Well Installation Contract Review and Revision, and (4) TAC and DOE Communications Improvement. The hours listed to implement the improvements are intended to be estimates for budgeting and planning purposes for the remainder of this fiscal year and the upcoming fiscal year.« less
  • Utility impacts from load management show great similarity if progam and demographic differences are taken into account. Data from 42 programs featuring direct load control or time-of-use rates offer utility analysis a basis for estimating load response to future efforts.