Reinforcement Learning-Based Adaptive Biofeedback Engine for Overground Walking Speed Training

Huanghe Zhang, Shuai Li, Qingya Zhao, Ashwini K. Rao, Yi Guo, Damiano Zanotto

Research output: Contribution to journalArticlepeer-review

4 Scopus citations

Abstract

Wearable biofeedback systems (WBS) have been proposed to aid physical rehabilitation of individuals with motor impairments. Due to significant inter-and intra-individual differences, the effectiveness of a given biofeedback strategy may vary for different users and across therapeutic sessions, as a patient's functional recovery progresses. To date, only a paucity of research has investigated the use of biofeedback strategies that can self-Adapt based on the user's response. This letter introduces a novel reinforcement learning with fuzzy logic biofeedback engine (RLFLE) for personalized overground walking speed training. The method leverages reinforcement learning and a fuzzy inference strategy to continuously modulate underfoot vibrotactile stimuli that encourage users to achieve a target walking speed. This stimulation strategy also enables the determination of a user's maximum steady-state walking speed during a gait training session overground. The RLFLE was implemented in a custom-engineered WBS and validated against two simpler biofeedback strategies during walking tests with healthy adults. Participants showed lower walking speed errors when training with the RLFLE. Additionally, results indicate that the new method is more effective in determining an individual's maximum steady-state walking speed. Given the importance of walking speed as an indicator of health status and as an essential outcome of exercise-based interventions, these results show promise for implementation in future technology-enhanced gait rehabilitation protocols.

Original languageEnglish
Pages (from-to)8487-8494
Number of pages8
JournalIEEE Robotics and Automation Letters
Volume7
Issue number3
DOIs
StatePublished - 1 Jul 2022

Keywords

  • Wearable biofeedback system
  • fuzzy logic
  • gait training
  • human-in-The-loop
  • instrumented footwear
  • reinforcement learning

Fingerprint

Dive into the research topics of 'Reinforcement Learning-Based Adaptive Biofeedback Engine for Overground Walking Speed Training'. Together they form a unique fingerprint.

Cite this