A differential game approach to dynamic competitive decisions toward human-computer collaboration

Alparslan Emrah Bayrak, Jonathan Cagan, Christopher McComb, Kenneth Kotovsky

    Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

    2 Scopus citations

    Abstract

    Partnership between humans and computers has a significant potential to extend the ability of humans to address complex design problems. This paper presents a decision-making process for computers to effectively collaborate with humans in the solution of complex problems under dynamic competition. In the proposed process, the computers learn strategies and objectives from prior experimental data and provide strategy suggestions to human collaborators. The study integrates clustering and sequential learning methods from machine learning with a differential game formulation based on model predictive control to find dynamic Nash equilibrium solutions to zero-sum games. The application of the proposed approach is demonstrated on the real-time strategy game Starcraft II that offers a dynamic competitive problem comparable in complexity to real-world applications. The results show that the proposed approach can successfully identify a variety of opening strategies in the experimental data for the initial phase of the process. The game-theoretic strategies in the later phases provide useful suggestions for low-performing players but are unnecessarily conservative for high-performing players where there is little opportunity for improvement. These results suggest a need for an assessment of the opponent expertise and a human intuition to judge the appropriateness of the game-theoretic suggestions for further improvement.

    complex

    Original languageEnglish
    Title of host publication31st International Conference on Design Theory and Methodology
    ISBN (Electronic)9780791859278
    DOIs
    StatePublished - 2019
    EventASME 2019 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC-CIE 2019 - Anaheim, United States
    Duration: 18 Aug 201921 Aug 2019

    Publication series

    NameProceedings of the ASME Design Engineering Technical Conference
    Volume7

    Conference

    ConferenceASME 2019 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC-CIE 2019
    Country/TerritoryUnited States
    CityAnaheim
    Period18/08/1921/08/19

    Fingerprint

    Dive into the research topics of 'A differential game approach to dynamic competitive decisions toward human-computer collaboration'. Together they form a unique fingerprint.

    Cite this