FEW questions, many answers: using machine learning to assess how students connect food–energy–water (FEW) concepts
[2]
- Aims Community College, Greeley, CO (United States)
- University of Northern Colorado, Greeley, CO (United States)
- Michigan State Univ., East Lansing, MI (United States)
- Unity Environmental University, ME (United States)
- Rider University, Lawrenceville, NJ (United States)
- Metropolitan State University of Denver, CO (United States)
- Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)
- Vincent Evaluation Consulting LLC, Tulsa, OK (United States)
There is growing support and interest in postsecondary interdisciplinary environmental education which integrate concepts and disciplines in addition to providing varied perspectives. There is a need to assess student learning in these programs as well as rigorous evaluation of educational practices, especially of complex synthesis concepts. This work tests a text classification machine learning model as a tool to assess student systems thinking capabilities using two questions anchored by the Food-Energy-Water (FEW) Nexus phenomena by answering two questions (1) Can machine learning models be used to identify instructor-determined important concepts in student responses? (2) What do college students know about the interconnections between food, energy and water, and how have students assimilated systems thinking into their constructed responses about FEW? Reported here are a broad range of model performances across 26 text classification models associated with two different assessment items, with model accuracy ranging from 0.755 to 0.992. Expert-like responses were infrequent in our dataset compared to responses providing simpler, incomplete explanations of the systems presented in the question. For those students moving from describing individual effects to multiple effects, their reasoning about the mechanism behind the system indicates advanced systems thinking ability. Specifically, students exhibit higher expertise for explaining changing water usage than discussing tradeoffs for such changing usage. This research represents one of the first attempts to assess the links between foundational, discipline-specific concepts and systems thinking ability. These text classification approaches to scoring student FEW Nexus Constructed Responses (CR) indicate how these approaches can be used, in addition to several future research priorities for interdisciplinary, practice-based education research. Development of further complex question items using machine learning would allow evaluation of the relationship between foundational concept understanding and integration of those concepts as well as more nuanced understanding of student comprehension of complex interdisciplinary concepts.
- Research Organization:
- Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)
- Sponsoring Organization:
- USDOE; National Science Foundation (NSF)
- Grant/Contract Number:
- AC05-76RL01830
- OSTI ID:
- 2439114
- Report Number(s):
- PNNL-SA--191494
- Journal Information:
- Humanities & Social Sciences Communications, Journal Name: Humanities & Social Sciences Communications Journal Issue: 1 Vol. 11; ISSN 2662-9992
- Publisher:
- Springer NatureCopyright Statement
- Country of Publication:
- United States
- Language:
- English
Similar Records
Effects of 3D Virtual Simulators in the Introductory Wind Energy Course: A Tool for Teaching Engineering Concepts
Integrating Systems Thinking into Teaching Emerging Technologies.