TY - GEN
T1 - AGENT-BASED SIMULATION OF OPTIMAL TRUST IN A DECISION SUPPORT SYSTEM IN ONE-ON-ONE COLLABORATION
AU - Saremi, Mostaan Lotfalian
AU - Bayrak, Alparslan Emrah
N1 - Publisher Copyright:
Copyright © 2022 by ASME.
PY - 2022
Y1 - 2022
N2 - Intelligent systems that can effectively collaborate with human users can potentially expand human decision-making capabilities in numerous domains. An important factor that determines the effectiveness of these intelligent systems is trust from human users. How much a user should trust an intelligent system to maximize the benefits is an open question. In this paper, we present a quantitative analysis of the impact of trust on the collaboration between a human user and an intelligent decision support system (DSS) in binary classification problems. Using an agent-based simulation model, we represent trust as a static quantity averaged over a set of Monte Carlo simulations calculated based on a user’s self-confidence, confidence in a DSS, and agents’ expertise. Our results show the optimal level of self-confidence and confidence in a DSS needed to maximize the collaboration performance under different problem scenarios. The results indicate that with such an optimal level of confidence, the collaboration performance can exceed the performance of the individual agents alone. Further, our results also show that having a concentrated expertise on particular types of problems is more beneficial than being somewhat knowledgeable in multiple problems given that the expertise of the user and the DSS complement each other.
AB - Intelligent systems that can effectively collaborate with human users can potentially expand human decision-making capabilities in numerous domains. An important factor that determines the effectiveness of these intelligent systems is trust from human users. How much a user should trust an intelligent system to maximize the benefits is an open question. In this paper, we present a quantitative analysis of the impact of trust on the collaboration between a human user and an intelligent decision support system (DSS) in binary classification problems. Using an agent-based simulation model, we represent trust as a static quantity averaged over a set of Monte Carlo simulations calculated based on a user’s self-confidence, confidence in a DSS, and agents’ expertise. Our results show the optimal level of self-confidence and confidence in a DSS needed to maximize the collaboration performance under different problem scenarios. The results indicate that with such an optimal level of confidence, the collaboration performance can exceed the performance of the individual agents alone. Further, our results also show that having a concentrated expertise on particular types of problems is more beneficial than being somewhat knowledgeable in multiple problems given that the expertise of the user and the DSS complement each other.
UR - http://www.scopus.com/inward/record.url?scp=85142540062&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85142540062&partnerID=8YFLogxK
U2 - 10.1115/DETC2022-90770
DO - 10.1115/DETC2022-90770
M3 - Conference contribution
AN - SCOPUS:85142540062
T3 - Proceedings of the ASME Design Engineering Technical Conference
BT - 48th Design Automation Conference (DAC)
T2 - ASME 2022 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC-CIE 2022
Y2 - 14 August 2022 through 17 August 2022
ER -