TY - JOUR
T1 - Performance of heterogeneous robot teams with personality adjusted learning
AU - Recchia, Thomas
AU - Chung, Jae
AU - Pochiraju, Kishore
PY - 2014/1
Y1 - 2014/1
N2 - This paper presents a reinforcement learning algorithm, which is inspired by human team dynamics, for autonomous robotic multi agent applications. Individual agents on the team have heterogeneous capabilities and responsibilities. The learning algorithm assigns strictly local credit assignments to individual agents promoting scalability of the team size. The Personality Adjusted Learner (PAL) algorithm is applied to heterogeneous teams of robots with reward adjustments modified from earlier work on homogeneous teams and an information-based action personality type assignment algorithm has been incorporated. The PAL algorithm was tested in a robot combat scenario against both static and learning opponent teams. The PAL team studied included distinct commander, driver, and gunner agents for each robot. The personality preferences for each agent were varied systematically to uncover team performance sensitivities to agent personality preference assignments. The results show a significant sensitivity for the commander agent. This agent selected the robot strategy, and it was noted that the better performing commander personalities were linked to team oriented actions, rather than more selfish strategies. The driver and gunner agent performance remained insensitive to personality assignment. The driver and gunner actions did not apply at the strategic level, indicating that personality preferences may be important for agents responsible for learning to cooperate intentionally with teammates.
AB - This paper presents a reinforcement learning algorithm, which is inspired by human team dynamics, for autonomous robotic multi agent applications. Individual agents on the team have heterogeneous capabilities and responsibilities. The learning algorithm assigns strictly local credit assignments to individual agents promoting scalability of the team size. The Personality Adjusted Learner (PAL) algorithm is applied to heterogeneous teams of robots with reward adjustments modified from earlier work on homogeneous teams and an information-based action personality type assignment algorithm has been incorporated. The PAL algorithm was tested in a robot combat scenario against both static and learning opponent teams. The PAL team studied included distinct commander, driver, and gunner agents for each robot. The personality preferences for each agent were varied systematically to uncover team performance sensitivities to agent personality preference assignments. The results show a significant sensitivity for the commander agent. This agent selected the robot strategy, and it was noted that the better performing commander personalities were linked to team oriented actions, rather than more selfish strategies. The driver and gunner agent performance remained insensitive to personality assignment. The driver and gunner actions did not apply at the strategic level, indicating that personality preferences may be important for agents responsible for learning to cooperate intentionally with teammates.
KW - Heterogeneous robot team
KW - Multi-agent system
KW - Myers-Briggs Type Indicator
KW - Reinforcement learning
KW - Robot teaming
UR - http://www.scopus.com/inward/record.url?scp=84892435134&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84892435134&partnerID=8YFLogxK
U2 - 10.1016/j.bica.2013.10.003
DO - 10.1016/j.bica.2013.10.003
M3 - Article
AN - SCOPUS:84892435134
SN - 2212-683X
VL - 7
SP - 87
EP - 97
JO - Biologically Inspired Cognitive Architectures
JF - Biologically Inspired Cognitive Architectures
ER -