skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: The Ground Truth Program: Simulations as Test Beds for Social Science Research Methods.

Journal Article · · Computational and Mathematical Organization Theory

Social systems are uniquely complex and difficult to study, but understanding them is vital to solving the world’s problems. The Ground Truth program developed a new way of testing the research methods that attempt to understand and leverage the Human Domain and its associated complexities. The program developed simulations of social systems as virtual world test beds. Not only were these simulations able to produce data on future states of the system under various circumstances and scenarios, but their causal ground truth was also explicitly known. Research teams studied these virtual worlds, facilitating deep validation of causal inference, prediction, and prescription methods. The Ground Truth program model provides a way to test and validate research methods to an extent previously impossible, and to study the intricacies and interactions of different components of research.

Research Organization:
Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Sponsoring Organization:
USDOE National Nuclear Security Administration (NNSA); Defense Advanced Research Projects Agency (DARPA)
Grant/Contract Number:
NA0003525
OSTI ID:
1894598
Report Number(s):
SAND2022-4400J; 704940
Journal Information:
Computational and Mathematical Organization Theory, Vol. 29, Issue 1; ISSN 1381-298X
Publisher:
SpringerCopyright Statement
Country of Publication:
United States
Language:
English

References (18)

Measuring the predictability of life outcomes with a scientific mass collaboration journal March 2020
Computational social science: Obstacles and opportunities journal August 2020
Does big data serve policy? Not without context. An experiment with in silico social science journal November 2022
Groups, governance, and greed: the ACCESS world model journal December 2021
Searching for explanations: testing social scientific methods in synthetic ground-truthed worlds journal January 2022
Dynamic models of segregation† journal July 1971
Hierarchy Measure for Complex Networks journal March 2012
Verification, Validation, and Confirmation of Numerical Models in the Earth Sciences journal February 1994
SCAMP’s stigmergic model of social conflict journal November 2021
Urban life: a model of people and places journal November 2021
What can simulation test beds teach us about social science? Results of the ground truth program journal April 2022
Clustering by Compression journal April 2005
Should social science be more solution-oriented? journal January 2017
Data-Driven Computational Social Science: A Survey journal September 2020
What is a complex system? journal June 2012
A manifesto for reproducible science journal January 2017
Disaster world journal May 2022
Social Data: Biases, Methodological Pitfalls, and Ethical Boundaries journal July 2019

Similar Records

What can simulation test beds teach us about social science? Results of the ground truth program
Journal Article · Sat Apr 30 00:00:00 EDT 2022 · Computational and Mathematical Organization Theory · OSTI ID:1894598

Explaining and predicting human behavior and social dynamics in simulated virtual worlds: reproducibility, generalizability, and robustness of causal discovery methods
Journal Article · Thu Nov 18 00:00:00 EST 2021 · Computational and Mathematical Organization Theory · OSTI ID:1894598

Taxonomy of USA east coast fishing communities in terms of social vulnerability and resilience
Journal Article · Sun Nov 15 00:00:00 EST 2015 · Environmental Impact Assessment Review · OSTI ID:1894598