TY - GEN
T1 - Systems thinking assessment
T2 - 41st Computers and Information in Engineering Conference, CIE 2021, Held as Part of the ASME 2021 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC-CIE 2021
AU - Arnold, Ross D.
AU - Wade, Jon P.
AU - Bayrak, Alparslan Emrah
N1 - Publisher Copyright:
Copyright © 2021 by ASME
PY - 2021
Y1 - 2021
N2 - This paper presents a novel assessment method for Systems Thinking and its supporting competencies. Systems Thinking is a key component in engineering education, providing students with the means to explore, understand, and design engineered systems both holistically and in terms of the relationships between their components, which can be both technical and non-technical. The assessment method described in this paper is implemented as a software simulation of a domain-agnostic system to support integration of Systems Thinking into engineering education. The simulation was tested with a group of beta-testers and then fully deployed online as a freely available tool for a 6-month experimental period. The pool of volunteer participants included students and mixed professionals from a diverse set of geographical, educational, and career backgrounds. Results of the assessment show success at both evaluating Systems Thinking Maturity as a whole, and at assessing complex facets of Systems Thinking that have eluded assessment in prior methods. The tool shows promise at evaluating competencies within all four Systems Thinking domains - Mindset, Content, Structure, and Behavior. These domains contain key systemic skills such as the ability to recognize interconnections and feedback loops, see non-linear causal relationships, and understand dynamic behavior. When examined holistically through multiple regression analysis, participants' scores in the 11 assessed competencies show a moderate to high ability to predict their levels of overall Systems Thinking performance in the simulation. The results also reveal previously unknown dependencies and strengths of relationships between Systems Thinking competencies.
AB - This paper presents a novel assessment method for Systems Thinking and its supporting competencies. Systems Thinking is a key component in engineering education, providing students with the means to explore, understand, and design engineered systems both holistically and in terms of the relationships between their components, which can be both technical and non-technical. The assessment method described in this paper is implemented as a software simulation of a domain-agnostic system to support integration of Systems Thinking into engineering education. The simulation was tested with a group of beta-testers and then fully deployed online as a freely available tool for a 6-month experimental period. The pool of volunteer participants included students and mixed professionals from a diverse set of geographical, educational, and career backgrounds. Results of the assessment show success at both evaluating Systems Thinking Maturity as a whole, and at assessing complex facets of Systems Thinking that have eluded assessment in prior methods. The tool shows promise at evaluating competencies within all four Systems Thinking domains - Mindset, Content, Structure, and Behavior. These domains contain key systemic skills such as the ability to recognize interconnections and feedback loops, see non-linear causal relationships, and understand dynamic behavior. When examined holistically through multiple regression analysis, participants' scores in the 11 assessed competencies show a moderate to high ability to predict their levels of overall Systems Thinking performance in the simulation. The results also reveal previously unknown dependencies and strengths of relationships between Systems Thinking competencies.
KW - Systems dynamics
KW - Systems literacy
KW - Systems science
KW - Systems theory
KW - Systems thinking maturity
UR - http://www.scopus.com/inward/record.url?scp=85119951953&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85119951953&partnerID=8YFLogxK
U2 - 10.1115/DETC2021-68180
DO - 10.1115/DETC2021-68180
M3 - Conference contribution
AN - SCOPUS:85119951953
T3 - Proceedings of the ASME Design Engineering Technical Conference
BT - 41st Computers and Information in Engineering Conference (CIE)
Y2 - 17 August 2021 through 19 August 2021
ER -