Feedback density and causal complexity of simulation model structure
- Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Measures of simulation model complexity generally focus on outputs; we propose measuring the complexity of a model’s causal structure to gain insight into its fundamental character. This article introduces tools for measuring causal complexity. First, we introduce a method for developing a model’s causal structure diagram, which characterises the causal interactions present in the code. Causal structure diagrams facilitate comparison of simulation models, including those from different paradigms. Next, we develop metrics for evaluating a model’s causal complexity using its causal structure diagram. We discuss cyclomatic complexity as a measure of the intricacy of causal structure and introduce two new metrics that incorporate the concept of feedback, a fundamental component of causal structure. The first new metric introduced here is feedback density, a measure of the cycle-based interconnectedness of causal structure. The second metric combines cyclomatic complexity and feedback density into a comprehensive causal complexity measure. Finally, we demonstrate these complexity metrics on simulation models from multiple paradigms and discuss potential uses and interpretations. These tools enable direct comparison of models across paradigms and provide a mechanism for measuring and discussing complexity based on a model’s fundamental assumptions and design.
- Research Organization:
- Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
- Sponsoring Organization:
- USDOE National Nuclear Security Administration (NNSA); Defense Advanced Research Projects Agency (DARPA)
- Grant/Contract Number:
- NA0003525; HR0011937661
- OSTI ID:
- 1828789
- Report Number(s):
- SAND-2021-11513J; 699448
- Journal Information:
- Journal of Simulation, Vol. 17, Issue 3; ISSN 1747-7778
- Publisher:
- Taylor & FrancisCopyright Statement
- Country of Publication:
- United States
- Language:
- English
Similar Records
A Causal Inference Model Based on Random Forests to Identify the Effect of Soil Moisture on Precipitation
Diagnosing the Dynamics of Observed and Simulated Ecosystem Gross Primary Productivity with Time Causal Information Theory Quantifiers