A Review of Visualization Methods for Cyber-Physical Security: Smart Grid Case Study

Cobilean, Victor; Mavikumbure, Harindra S.; Mcbride, Brady J.; Vaagensmith, Bjorn; Singh, Vivek Kumar; Li, Ruixuan; Rieger, Craig; Manic, Milos

doi:10.1109/access.2023.3286304

Title: A Review of Visualization Methods for Cyber-Physical Security: Smart Grid Case Study

Journal Article · Wed Jun 14 00:00:00 EDT 2023 · IEEE Access

DOI:https://doi.org/10.1109/access.2023.3286304· OSTI ID:1985176

^[1];

^[1]; Mcbride, Brady J. ^[2]; Vaagensmith, Bjorn ^[3];

^[4]; Li, Ruixuan ^[3];

^[3];

^[1]

Virginia Commonwealth University, Richmond, VA (United States)
University of Arkansas, Fayetteville, AR (United States)
Idaho National Laboratory (INL), Idaho Falls, ID (United States)
National Renewable Energy Laboratory (NREL), Golden, CO, USA

Cyber-Physical Systems (CPSs) are becoming increasingly complex and interconnected as they attempt to meet the demands of evolving society. As a result, monitoring and maintaining them becomes a more complex and demanding task for control system operators and cyber defenders. While the literature on visualization techniques in the context of cybersecurity is extensive, the same cannot be said for studies on visualization for the security of cyber-physical systems. This paper aims to fill that gap by: 1) defining the main features of a visualizations workflow for security visualizations in cyber-physical systems. The workflow includes the acquisition of cyber and physical data, processing of data, selection, and configuration of both visualization tools and end-user interactions. 2) Providing an overview of cyber-physical security visualization systems, with a focus on smart grids as a case study. Finally, we use the perspectives gained from this analysis to provide insights and directions for future research and design of cyber-physical visualization techniques.

View Journal Article

Cite

Export

Save

Research Organization:: National Renewable Energy Laboratory (NREL), Golden, CO (United States); Idaho National Laboratory (INL), Idaho Falls, ID (United States)

Sponsoring Organization:: USDOE Office of Energy Efficiency and Renewable Energy (EERE), Renewable Power Office. Solar Energy Technologies Office

Grant/Contract Number:: AC36-08GO28308; 0008775; AC07-05ID14517

OSTI ID:: 1985176

Alternate ID(s):: OSTI ID: 1986372; OSTI ID: 1992305; OSTI ID: 1994187

Report Number(s):: NREL/JA-5R00-86961; INL/JOU-22-69829-Rev000; 10151850

Journal Information:: IEEE Access, Journal Name: IEEE Access Vol. 11; ISSN 2169-3536

Publisher:: IEEECopyright Statement

Country of Publication:: United States

Language:: English

References (71)

Big Data Visualization: A Survey Mohammed, Luay Thamer; AlHabshy, AbdAllah A.; ElDahshan, Kamal A. 2022 International Congress on Human-Computer Interaction, Optimization and Robotic Applications (HORA) https://doi.org/10.1109/HORA55278.2022.9799819	conference	June 2022
A survey of security visualization for computer network logs Zhang, Yanping; Xiao, Yang; Chen, Min Security and Communication Networks, Vol. 5, Issue 4 https://doi.org/10.1002/sec.324	journal	May 2011
A Task Centered Framework for Computer Security Data Visualization Suo, Xiaoyuan; Zhu, Ying; Owen, Scott Visualization for Computer Security https://doi.org/10.1007/978-3-540-85933-8_9	book	January 2008
A Survey on Cybersecurity Challenges, Detection, and Mitigation Techniques for the Smart Grid Tufail, Shahid; Parvez, Imtiaz; Batool, Shanzeh Energies, Vol. 14, Issue 18 https://doi.org/10.3390/en14185894	journal	September 2021
Wireless sensor network security visualization Karapistoli, Eirini; Economides, Anastasios A. 2012 IV International Congress on Ultra Modern Telecommunications and Control Systems https://doi.org/10.1109/ICUMT.2012.6459781	conference	October 2012
A Tri-Modular Human-on-the-Loop Framework for Intelligent Smart Grid Cyber-Attack Visualization Sundararajan, Aditya; Khan, Tanwir; Aburub, Haneen SoutheastCon 2018 https://doi.org/10.1109/SECON.2018.8479180	conference	April 2018
GridAttackAnalyzer: A Cyber Attack Analysis Framework for Smart Grids Le, Tan Duy; Ge, Mengmeng; Anwar, Adnan Sensors, Vol. 22, Issue 13 https://doi.org/10.3390/s22134795	journal	June 2022
Employing a User-Centered Design Process for Cybersecurity Awareness in the Power Grid Scholtz, Jean C.; Franklin, Lyndsey; Ashok, Aditya Journal of Human Performance in Extreme Environments, Vol. 14, Issue 1 https://doi.org/10.7771/2327-2937.1094	journal	January 2018
Visualization Techniques for Electrical Grid Smart Metering Data: A Survey Stefan, Maria; Lopez, Jose G.; Andreasen, Morten H. 2017 IEEE Third International Conference on Big Data Computing Service and Applications (BigDataService) https://doi.org/10.1109/BigDataService.2017.26	conference	April 2017
Looking for a Black Cat in a Dark Room: Security Visualization for Cyber-Physical System Design and Analysis Bakirtzis, Georgios; Simon, Brandon J.; Fleming, Cody H. 2018 IEEE Symposium on Visualization for Cyber Security (VizSec) https://doi.org/10.1109/VIZSEC.2018.8709187	conference	October 2018
A Survey on ML4VIS: Applying Machine Learning Advances to Data Visualization Wang, Qianwen; Chen, Zhutian; Wang, Yong IEEE Transactions on Visualization and Computer Graphics, Vol. 28, Issue 12 https://doi.org/10.1109/TVCG.2021.3106142	journal	December 2022
A survey on information visualization: recent advances and challenges Liu, Shixia; Cui, Weiwei; Wu, Yingcai The Visual Computer, Vol. 30, Issue 12 https://doi.org/10.1007/s00371-013-0892-3	journal	January 2014
A survey of Cyber-Physical Systems Shi, Jianhua; Wan, Jiafu; Yan, Hehua Signal Processing (WCSP 2011), 2011 International Conference on Wireless Communications and Signal Processing (WCSP) https://doi.org/10.1109/WCSP.2011.6096958	conference	November 2011
Massive Data Visualization: A Survey Joy, Kenneth I. Mathematics and Visualization https://doi.org/10.1007/b106657_15	book	January 2009
A Statistical Comparison of Security Visualization Efficiency Compared to Manual Analysis of IDS Log Data Freet, David; Agrawal, Rajeev SoutheastCon 2018 https://doi.org/10.1109/SECON.2018.8479107	conference	April 2018
PERCIVAL: proactive and reactive attack and response assessment for cyber incidents using visual analytics Angelini, Marco; Prigent, Nicolas; Santucci, Giuseppe 2015 IEEE Symposium on Visualization for Cyber Security (VizSec) https://doi.org/10.1109/VIZSEC.2015.7312764	conference	October 2015
Cyber–Physical System Security for the Electric Power Grid Sridhar, Siddharth; Hahn, Adam; Govindarasu, Manimaran Proceedings of the IEEE, Vol. 100, Issue 1 https://doi.org/10.1109/JPROC.2011.2165269	journal	January 2012
Security in Process: Visually Supported Triage Analysis in Industrial Process Data Lohfink, Anna-Pia; Anton, Simon D. Duque; Schotten, Hans Dieter IEEE Transactions on Visualization and Computer Graphics, Vol. 26, Issue 4 https://doi.org/10.1109/TVCG.2020.2969007	journal	April 2020
Modeling and visualization of Smart Power Grid: Real time contingency and security aspects Chopade, Pravin; Flurchick, K. M.; Bikdash, Marwan 2012 Proceedings of IEEE Southeastcon https://doi.org/10.1109/SECon.2012.6196928	conference	March 2012
Attack Graph Implementation and Visualization for Cyber Physical Systems Ibrahim, Mariam; Al-Hindawi, Qays; Elhafiz, Ruba Processes, Vol. 8, Issue 1 https://doi.org/10.3390/pr8010012	journal	December 2019
Cyber security data sources for dynamic network research Kent, Alexander D. Dynamic Networks and Cyber-Security https://doi.org/10.1142/9781786340757_0002	book	March 2016
Multivariate spatial data visualization: a survey He, Xiangyang; Tao, Yubo; Wang, Qirui Journal of Visualization, Vol. 22, Issue 5 https://doi.org/10.1007/s12650-019-00584-3	journal	August 2019
Privacy-Preserving Schemes for Safeguarding Heterogeneous Data Sources in Cyber-Physical Systems Keshk, Marwa; Turnbull, Benjamin; Sitnikova, Elena IEEE Access, Vol. 9 https://doi.org/10.1109/ACCESS.2021.3069737	journal	January 2021
Characterizing cyber tools for monitoring power grid systems: What information is available and who needs it? Le Blanc, Katya; Ashok, Aditya; Franklin, Lyndsey 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC) https://doi.org/10.1109/SMC.2017.8123164	conference	October 2017
The eyes have it: a task by data type taxonomy for information visualizations Shneiderman, B. Proceedings 1996 IEEE Symposium on Visual Languages https://doi.org/10.1109/VL.1996.545307	conference	January 1996
A Comprehensive Analysis of Smart Grid Systems against Cyber-Physical Attacks Wadhawan, Yatin; AlMajali, Anas; Neuman, Clifford Electronics, Vol. 7, Issue 10 https://doi.org/10.3390/electronics7100249	journal	October 2018
An evaluation framework for network security visualizations Sharafaldin, Iman; Lashkari, Arash Habibi; Ghorbani, Ali A. Computers & Security, Vol. 84 https://doi.org/10.1016/j.cose.2019.03.005	journal	July 2019
A Survey of Visualization Systems for Network Security Shiravi, H.; Shiravi, A.; Ghorbani, A. A. IEEE Transactions on Visualization and Computer Graphics, Vol. 18, Issue 8 https://doi.org/10.1109/TVCG.2011.144	journal	August 2012
Systematic Literature Review on Cyber Situational Awareness Visualizations Jiang, Liuyue; Jayatilaka, Asangi; Nasim, Mehwish IEEE Access, Vol. 10 https://doi.org/10.1109/ACCESS.2022.3178195	journal	January 2022
Visualization for cyber security command and control Langton, John T.; Newey, Brent; Havig, Paul R. SPIE Proceedings https://doi.org/10.1117/12.850646	conference	April 2010
Anomaly Detection Using Pattern-of-Life Visual Metaphors Happa, Jassim; Bashford-Rogers, Thomas; Agrafiotis, Ioannis IEEE Access, Vol. 7 https://doi.org/10.1109/ACCESS.2019.2948490	journal	January 2019
A taxonomy for attack graph generation and usage in network security Kaynar, Kerem Journal of Information Security and Applications, Vol. 29 https://doi.org/10.1016/j.jisa.2016.02.001	journal	August 2016
A Tool to Support the Investigation and Visualization of Cyber and/or Physical Incidents Macedo, Inês; Wanous, Sinan; Oliveira, Nuno Advances in Intelligent Systems and Computing https://doi.org/10.1007/978-3-030-72654-6_13	book	January 2021
CyberSAVe Matuszak, William J.; DiPippo, Lisa; Sun, Yan Lindsay Proceedings of the Tenth Workshop on Visualization for Cyber Security https://doi.org/10.1145/2517957.2517961	conference	October 2013
A PMU-Based Method for Smart Transmission Grid Voltage Security Visualization and Monitoring Su, Heng-Yi; Liu, Tzu-Yi Energies, Vol. 10, Issue 8 https://doi.org/10.3390/en10081103	journal	July 2017
Data visualization via latent variables and mixture models: a brief survey Priam, Rodolphe; Nadif, Mohamed Pattern Analysis and Applications, Vol. 19, Issue 3 https://doi.org/10.1007/s10044-015-0521-z	journal	November 2015
A survey on visualization approaches for exploring association relationships in graph data Chen, Yi; Guan, Zeli; Zhang, Rong Journal of Visualization, Vol. 22, Issue 3 https://doi.org/10.1007/s12650-019-00551-y	journal	April 2019
Graph analytics and visualization for cyber situational understanding Noel, Steven; Purdy, Stephen; O’Rourke, Annie The Journal of Defense Modeling and Simulation: Applications, Methodology, Technology, Vol. 20, Issue 1 https://doi.org/10.1177/15485129211051385	journal	October 2021
Survey on Visual Analysis of Event Sequence Data Guo, Yi; Guo, Shunan; Jin, Zhuochen IEEE Transactions on Visualization and Computer Graphics, Vol. 28, Issue 12 https://doi.org/10.1109/TVCG.2021.3100413	journal	December 2022
A Process Framework for Stakeholder-specific Visualization of Security Metrics Hanauer, Tanja; Hommel, Wolfgang; Metzger, Stefan Proceedings of the 13th International Conference on Availability, Reliability and Security https://doi.org/10.1145/3230833.3232855	conference	August 2018
Anomaly Detection in Critical-Infrastructures using Autoencoders: A Survey Mavikumbure, Harindra S.; Wickramasinghe, Chathurika S.; Marino, Daniel L. IECON 2022 – 48th Annual Conference of the IEEE Industrial Electronics Society https://doi.org/10.1109/IECON49645.2022.9968505	conference	October 2022
Data visualization in smart grid and low‐carbon energy systems: A review Chen, Xi; Chen, Xinyu International Transactions on Electrical Energy Systems, Vol. 31, Issue 7 https://doi.org/10.1002/2050-7038.12889	journal	May 2021
Interactive Visualization for Network and Port Scan Detection Muelder, Chris; Ma, Kwan-Liu; Bartoletti, Tony Lecture Notes in Computer Science https://doi.org/10.1007/11663812_14	book	January 2006
MAHIVE: Modular Analysis Hierarchical Intrusion Detection System Visualization Event Cybersecurity Engine for Cyber-Physical Systems and Internet of Things Devices Steiner, Stuart; Oyewumi, Ibukun; Conte De Leon, Daniel Proceedings of the Annual Hawaii International Conference on System Sciences https://doi.org/10.24251/HICSS.2021.854	conference	January 2021
A Comprehensive State-of-the-Art Survey on Data Visualization Tools: Research Developments, Challenges and Future Domain Specific Visualization Framework Shakeel, Hafiz Muhammad; Iram, Shamaila; Al-Aqrabi, Hussain IEEE Access, Vol. 10 https://doi.org/10.1109/ACCESS.2022.3205115	journal	January 2022
Trends in big data analytics Kambatla, Karthik; Kollias, Giorgos; Kumar, Vipin Journal of Parallel and Distributed Computing, Vol. 74, Issue 7 https://doi.org/10.1016/j.jpdc.2014.01.003	journal	July 2014
CyVi: Visualization of Cyber-Attack and Defense Effects in Geographically Referenced Networks Muhati, Eric; Rawat, Danda B.; Garuba, Moses 2020 IEEE 17th Annual Consumer Communications & Networking Conference (CCNC) https://doi.org/10.1109/CCNC46108.2020.9045158	conference	January 2020
Time series segmentation: A sliding window approach Chu, Chia-Shang James Information Sciences, Vol. 85, Issue 1-3 https://doi.org/10.1016/0020-0255(95)00021-G	journal	July 1995
Cpsa Saxena, Neetesh; Chukwuka, Victor; Xiong, Leilei Proceedings of the 2017 Workshop on Cyber-Physical Systems Security and PrivaCy https://doi.org/10.1145/3140241.3140246	conference	November 2017
Visualization of Security Metrics for Cyber Situation Awareness Kotenko, Igor; Novikova, Evgenia 2014 Ninth International Conference on Availability, Reliability and Security https://doi.org/10.1109/ARES.2014.75	conference	September 2014
Visual analytics of cyber physical data streams using spatio-temporal radial pixel visualization Hao, M.; Marwah, M.; Mittelstaedt, S. SPIE Proceedings https://doi.org/10.1117/12.2002948	conference	February 2013
Nonlinear dimensionality reduction and data visualization: A review Yin, Hujun International Journal of Automation and Computing, Vol. 4, Issue 3 https://doi.org/10.1007/s11633-007-0294-y	journal	July 2007
A Survey on Visualization Techniques Used for Big Data Analytics Hirve, Sumit; Pradeep Reddy, C. H. Advances in Intelligent Systems and Computing https://doi.org/10.1007/978-981-13-6861-5_39	book	January 2019
A data-driven approach for online dynamic security assessment with spatial-temporal dynamic visualization using random bits forest Liu, Songkai; Liu, Lihuang; Yang, Nan International Journal of Electrical Power & Energy Systems, Vol. 124 https://doi.org/10.1016/j.ijepes.2020.106316	journal	January 2021
Visualizing Cascading Failures in Critical Cyber Infrastructures Kopylec, Jason; D'Amico, Anita; Goodall, John Critical Infrastructure Protection https://doi.org/10.1007/978-0-387-75462-8_25	book	January 2008
An integrated visualization approach for smart grid attacks Yan, Jun; Yang, Yida; Wang, Wenkai 2012 Third International Conference on Intelligent Control and Information Processing https://doi.org/10.1109/ICICIP.2012.6391513	conference	July 2012
AI4VIS: Survey on Artificial Intelligence Approaches for Data Visualization Wu, Aoyu; Wang, Yun; Shu, Xinhuan IEEE Transactions on Visualization and Computer Graphics, Vol. 28, Issue 12 https://doi.org/10.1109/TVCG.2021.3099002	journal	December 2022
Testbed-based Evaluation of SIEM Tool for Cyber Kill Chain Model in Power Grid SCADA System Singh, Vivek Kumar; Callupe, Steven Perez; Govindarasu, Manimaran 2019 North American Power Symposium (NAPS) https://doi.org/10.1109/NAPS46351.2019.9000344	conference	October 2019
SURE: A Modeling and Simulation Integration Platform for Evaluation of Secure and Resilient Cyber–Physical Systems Koutsoukos, Xenofon; Karsai, Gabor; Laszka, Aron Proceedings of the IEEE, Vol. 106, Issue 1 https://doi.org/10.1109/JPROC.2017.2731741	journal	January 2018
Information visualization and visual data mining Keim, D. A. IEEE Transactions on Visualization and Computer Graphics, Vol. 8, Issue 1 https://doi.org/10.1109/2945.981847	journal	January 2002
Cyber-Physical Systems Security—A Survey Humayed, Abdulmalik; Lin, Jingqiang; Li, Fengjun IEEE Internet of Things Journal, Vol. 4, Issue 6 https://doi.org/10.1109/JIOT.2017.2703172	journal	December 2017
A Full-Scale Security Visualization Effectiveness Measurement and Presentation Approach Garae, Jeffery; Ko, Ryan K. L.; Apperley, Mark 2018 17th IEEE International Conference On Trust, Security And Privacy In Computing And Communications/ 12th IEEE International Conference On Big Data Science And Engineering (TrustCom/BigDataSE) https://doi.org/10.1109/TrustCom/BigDataSE.2018.00095	conference	August 2018
Making data visualization more efficient and effective: a survey Qin, Xuedi; Luo, Yuyu; Tang, Nan The VLDB Journal, Vol. 29, Issue 1 https://doi.org/10.1007/s00778-019-00588-3	journal	November 2019
Hyperion: A Visual Analytics Tool for an Intrusion Detection and Prevention System Yoo, Seunghoon; Jo, Jaemin; Kim, Bohyoung IEEE Access, Vol. 8 https://doi.org/10.1109/ACCESS.2020.3010789	journal	January 2020
Big data analytics in smart grids: state‐of‐the‐art, challenges, opportunities, and future directions Bhattarai, Bishnu P.; Paudyal, Sumit; Luo, Yusheng IET Smart Grid, Vol. 2, Issue 2 https://doi.org/10.1049/iet-stg.2018.0261	journal	March 2019
A Visual Analytics Framework for Reviewing Multivariate Time-Series Data with Dimensionality Reduction Fujiwara, Takanori; Sakamoto, Naohisa IEEE Transactions on Visualization and Computer Graphics, Vol. 27, Issue 2 https://doi.org/10.1109/TVCG.2020.3028889	journal	February 2021
Review of Design Elements within Power Infrastructure Cyber–Physical Test Beds as Threat Analysis Environments Vaagensmith, Bjorn; Singh, Vivek Kumar; Ivans, Robert Energies, Vol. 14, Issue 5 https://doi.org/10.3390/en14051409	journal	March 2021
Detecting Flaws and Intruders with Visual Data Analysis IEEE Computer Graphics and Applications, Vol. 24, Issue 5 https://doi.org/10.1109/MCG.2004.26	journal	September 2004
A new concentric-circle visualization of multi-dimensional data and its application in network security Fu Lu, Liang; Wan Zhang, Jia; Lin Huang, Mao Journal of Visual Languages & Computing, Vol. 21, Issue 4 https://doi.org/10.1016/j.jvlc.2010.05.002	journal	August 2010
A Survey of Traffic Data Visualization Chen, Wei; Guo, Fangzhou; Wang, Fei-Yue IEEE Transactions on Intelligent Transportation Systems, Vol. 16, Issue 6 https://doi.org/10.1109/TITS.2015.2436897	journal	December 2015
Visualization and Visual Analysis of Ensemble Data: A Survey Wang, Junpeng; Hazarika, Subhashis; Li, Cheng IEEE Transactions on Visualization and Computer Graphics, Vol. 25, Issue 9 https://doi.org/10.1109/TVCG.2018.2853721	journal	September 2019

Similar Records

Cyber risk assessment and investment optimization using game theory and ML-based anomaly detection and mitigation for wide-area control in smart grids

Other · Mon Aug 01 00:00:00 EDT 2022 · OSTI ID:1985176

Hyder, Burhan

NEFTSec: Networked federation testbed for cyber-physical security of smart grid: Architecture, applications, and evaluation

Journal Article · Fri Aug 26 00:00:00 EDT 2022 · IET Cyber-Physical Systems: Theory & Applications · OSTI ID:1985176

Singh, Vivek Kumar; Govindarasu, Manimaran; Porschet, Donald; +2 more

Attack-resilient algorithms and testbed federation for wide-area protection and control in smart grid

Other · Wed Jan 01 00:00:00 EST 2020 · OSTI ID:1985176

Singh, Vivek Kumar

Related Subjects

24 POWER TRANSMISSION AND DISTRIBUTION
Cyber-physical security
Cyber-physical system visualization
Data visualization
Grids
Human factors
Resilience
Situational awareness

Title: A Review of Visualization Methods for Cyber-Physical Security: Smart Grid Case Study

Citation Formats

References (71)

Similar Records

Related Subjects