Semi-Supervised, Non-Intrusive Disaggregation of Nodal Load Profiles With Significant Behind-the-Meter Solar Generation

Moscovitz, Daniel; Zhao, Zhenyu; Du, Liang; Fan, Xiaoyuan

doi:10.1109/tpwrs.2023.3334995

Semi-Supervised, Non-Intrusive Disaggregation of Nodal Load Profiles With Significant Behind-the-Meter Solar Generation

Journal Article · Mon Nov 20 00:00:00 EST 2023 · IEEE Transactions on Power Systems

DOI:https://doi.org/10.1109/tpwrs.2023.3334995· OSTI ID:2339614

Moscovitz, Daniel ^[1]; ^[2]; ^[2]; ^[3]

PJM Interconnection, Audubon, PA (United States)
Temple Univ., Philadelphia, PA (United States)
Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)

It is of imperative interests for regional transmission organizations (RTOs) to effectively extract actual load profiles at transmission nodes with significant behind-the-meter solar generation, which remains a gap in the existing technology paradigm. This paper proposes an explicit yet efficient linear estimator to disaggregate actual load profiles at transmission buses with significant behind-the-meter (BTM) solar generations. The proposed estimator is based on disaggregating (i.e., extracting) at locations close to transmission buses under consideration. Further, to overcome the lack of “ground truth” and validate the performance of the proposed algorithms, we first propose semi-supervised mechanisms with parameter tuning as well as unsupervised clustering and leverage the unique characteristics of zero-crossing points in BTM solar peaking behaviors, which we refer to as “Zone-to-Node (Z2N)” methods. Next, we further propose a bi-level Node-to-Node (N2N) framework that improves the overall disaggregation performances compared to Z2N. Numerical results are presented using real-world data at PJM Interconnection.

View Accepted Manuscript (DOE)

Research Organization:: Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)

Sponsoring Organization:: USDOE

Grant/Contract Number:: AC05-76RL01830

OSTI ID:: 2339614

Report Number(s):: PNNL-SA--191770

Journal Information:: IEEE Transactions on Power Systems, Journal Name: IEEE Transactions on Power Systems Journal Issue: 3 Vol. 39; ISSN 0885-8950

Publisher:: IEEECopyright Statement

Country of Publication:: United States

Language:: English

References (29)

A survey on semi-supervised learning van Engelen, Jesper E.; Hoos, Holger H. Machine Learning, Vol. 109, Issue 2 https://doi.org/10.1007/s10994-019-05855-6	journal	November 2019
A Practical Approach to Feature Selection Kira, Kenji; Rendell, Larry A. Machine Learning Proceedings 1992 https://doi.org/10.1016/B978-1-55860-247-2.50037-1	book	January 1992
An area-based shape distance measure of time series Wang, Xiao; Yu, Fusheng; Pedrycz, Witold Applied Soft Computing, Vol. 48 https://doi.org/10.1016/j.asoc.2016.06.033	journal	November 2016
Forecasting day-ahead electricity load using a multiple equation time series approach Clements, A. E.; Hurn, A. S.; Li, Z. European Journal of Operational Research, Vol. 251, Issue 2 https://doi.org/10.1016/j.ejor.2015.12.030	journal	June 2016
Disaggregating solar generation from feeder-level measurements Kara, Emre C.; Roberts, Ciaran M.; Tabone, Michaelangelo Sustainable Energy, Grids and Networks, Vol. 13 https://doi.org/10.1016/j.segan.2017.11.001	journal	March 2018
A Fast Estimation Method for the Vector Autoregressive Moving Average Model with Exogenous Variables Spliid, Henrik Journal of the American Statistical Association, Vol. 78, Issue 384 https://doi.org/10.1080/01621459.1983.10477030	journal	December 1983
The self-organizing map Kohonen, T. Proceedings of the IEEE, Vol. 78, Issue 9 https://doi.org/10.1109/5.58325	journal	January 1990
A review of identification and monitoring methods for electric loads in commercial and residential buildings Du, Yi; Du, Liang; Lu, Bin 2010 IEEE Energy Conversion Congress and Exposition (ECCE) https://doi.org/10.1109/ECCE.2010.5618423	conference	September 2010
A Data-Driven Democratized Control Architecture for Regional Transmission Operators Fan, Xiaoyuan; Moscovitz, Daniel; Du, Liang 2022 IEEE Power & Energy Society Innovative Smart Grid Technologies Conference (ISGT) https://doi.org/10.1109/ISGT50606.2022.9817494	conference	April 2022
Self-organizing classification and identification of miscellaneous electric loads Du, L.; He, D.; Yang, Y. 2012 IEEE Power & Energy Society General Meeting. New Energy Horizons - Opportunities and Challenges, 2012 IEEE Power and Energy Society General Meeting https://doi.org/10.1109/PESGM.2012.6343927	conference	July 2012
Solar forecasting as an enablement tool for the distribution system operator (DSO) Tidemann, Carl E.; Bright, Jamie M.; Engerer, Nicholas A. 2019 IEEE 46th Photovoltaic Specialists Conference (PVSC) https://doi.org/10.1109/PVSC40753.2019.8980815	conference	June 2019
Unsupervised Disaggregation of Photovoltaic Production From Composite Power Flow Measurements of Heterogeneous Prosumers Sossan, Fabrizio; Nespoli, Lorenzo; Medici, Vasco IEEE Transactions on Industrial Informatics, Vol. 14, Issue 9 https://doi.org/10.1109/TII.2018.2791932	journal	September 2018
An Adaptive Machine Learning Framework for Behind-the-Meter Load/PV Disaggregation Saeedi, Ramyar; Sadanandan, Sajan K.; Srivastava, Anurag K. IEEE Transactions on Industrial Informatics, Vol. 17, Issue 10 https://doi.org/10.1109/TII.2021.3060898	journal	October 2021
A New Distance Measure for Model-Based Sequence Clustering Garcia-Garcia, D.; Hernandez, E. P.; Diaz de Maria, F. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 31, Issue 7 https://doi.org/10.1109/TPAMI.2008.268	journal	July 2009
Clustering Technique Applied to Nodal Reliability Indices for Optimal Planning of Energy Resources Lami, Badr; Bhattacharya, Kankar IEEE Transactions on Power Systems, Vol. 31, Issue 6 https://doi.org/10.1109/TPWRS.2015.2507061	journal	November 2016
A Data-Driven Game-Theoretic Approach for Behind-the-Meter PV Generation Disaggregation Bu, Fankun; Dehghanpour, Kaveh; Yuan, Yuxuan IEEE Transactions on Power Systems, Vol. 35, Issue 4 https://doi.org/10.1109/TPWRS.2020.2966732	journal	July 2020
A Linear Programming Approximation of Distributionally Robust Chance-Constrained Dispatch With Wasserstein Distance Zhou, Anping; Yang, Ming; Wang, Mingqiang IEEE Transactions on Power Systems, Vol. 35, Issue 5 https://doi.org/10.1109/TPWRS.2020.2978934	journal	September 2020
Data-Driven Distributionally Robust Unit Commitment With Wasserstein Metric: Tractable Formulation and Efficient Solution Method Zheng, Xiaodong; Chen, Haoyong IEEE Transactions on Power Systems, Vol. 35, Issue 6 https://doi.org/10.1109/TPWRS.2020.3014808	journal	November 2020
Disaggregating Customer-Level Behind-the-Meter PV Generation Using Smart Meter Data and Solar Exemplars Bu, Fankun; Dehghanpour, Kaveh; Yuan, Yuxuan IEEE Transactions on Power Systems, Vol. 36, Issue 6 https://doi.org/10.1109/TPWRS.2021.3074614	journal	November 2021
Bayesian Energy Disaggregation At Substations With Uncertainty Modeling Yi, Ming; Wang, Meng IEEE Transactions on Power Systems, Vol. 37, Issue 1 https://doi.org/10.1109/TPWRS.2021.3095047	journal	January 2022
Nonintrusive, Self-Organizing, and Probabilistic Classification and Identification of Plugged-In Electric Loads Du, Liang; Restrepo, Jose A.; Yang, Yi IEEE Transactions on Smart Grid, Vol. 4, Issue 3 https://doi.org/10.1109/TSG.2013.2263231	journal	September 2013
Separating Feeder Demand Into Components Using Substation, Feeder, and Smart Meter Measurements Ledva, Gregory S.; Mathieu, Johanna L. IEEE Transactions on Smart Grid, Vol. 11, Issue 4 https://doi.org/10.1109/TSG.2020.2967220	journal	July 2020
A Deep Generative Model for Non-Intrusive Identification of EV Charging Profiles Wang, Shengyi; Du, Liang; Ye, Jin IEEE Transactions on Smart Grid, Vol. 11, Issue 6 https://doi.org/10.1109/TSG.2020.2998080	journal	November 2020
Unsupervised Clustering-Based Short-Term Solar Forecasting Feng, Cong; Cui, Mingjian; Hodge, Bri-Mathias IEEE Transactions on Sustainable Energy, Vol. 10, Issue 4 https://doi.org/10.1109/TSTE.2018.2881531	journal	October 2019
Joint Estimation of Behind-the-Meter Solar Generation in a Community Kabir, Farzana; Yu, Nanpeng; Yao, Weixin IEEE Transactions on Sustainable Energy, Vol. 12, Issue 1 https://doi.org/10.1109/TSTE.2020.3016896	journal	January 2021
Least Absolute Deviations Curve-Fitting Bloomfield, Peter; Steiger, William SIAM Journal on Scientific and Statistical Computing, Vol. 1, Issue 2 https://doi.org/10.1137/0901019	journal	June 1980
Disaggregating solar generation behind individual meters in real time Tabone, Michaelangelo; Kiliccote, Sila; Kara, Emre Can Proceedings of the 5th Conference on Systems for Built Environments https://doi.org/10.1145/3276774.3276776	conference	November 2018
Quantile Regression Koenker, Roger; Hallock, Kevin F. Journal of Economic Perspectives, Vol. 15, Issue 4 https://doi.org/10.1257/jep.15.4.143	journal	November 2001
Queued Up: Characteristics of Power Plants Seeking Transmission Interconnection As of the End of 2022 [Slides] Rand, Joseph; Strauss, Rose; Gorman, Will https://doi.org/10.2172/1969977	report	April 2023

Similar Records

Semi-Supervised Disaggregation of Load Profiles at Transmission Buses with Significant Behind-the-Meter Solar Generations

Conference · Wed Nov 30 23:00:00 EST 2022 · OSTI ID:1906848

Deep Factorization Machine Learning for Disaggregation of Transmission Load Profiles with High Penetration of Behind-The-Meter Solar

Journal Article · Thu Jan 16 19:00:00 EST 2025 · IEEE Transactions on Industry Applications · OSTI ID:2574049

Bilevel Nodal Behind-the-meter Solar Disaggregation Under Unexpected Extreme Weather Conditions

Conference · Fri Oct 04 00:00:00 EDT 2024 · OSTI ID:2537870

Related Subjects

14 SOLAR ENERGY
behind-the-meter solar
grid analytics
grid integration of renewable energy
load disaggregation
load modeling
power measurement
smart meters
solar power generation
telemetry
tuning
voltage measurement

Semi-Supervised, Non-Intrusive Disaggregation of Nodal Load Profiles With Significant Behind-the-Meter Solar Generation

Citation Formats

References (29)

Similar Records

Related Subjects