Augmented Sensory Feedback during Training of Upper Extremity Function in Virtual Reality

Yu Shi, Mingxiao Liu, Sophie Dewil, Noam Y. Harel, Sean Sanford, Raviraj Nataraj

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

This study examined how varying the type (visual, haptic, or visual plus haptic) of augmented sensory feedback (ASF) cues used for guidance during motor training with virtual reality (VR) can uniquely impact performance and physiological responses indicative of cognitive load and physical arousal. This work aims to demonstrate the need and opportunity to optimize VR approaches for motor rehabilitation based on how the ASF is provided. This study utilized a custom VR platform for rehabilitating upper-body function for a myoelectric control task. Neurotypical participants (n=15) exerted near-isometric muscular exertions, and the resultant electromyographic (EMG) recordings were input to a support vector machine for commanding movement of a VR robot arm tasked to contact various targets. Motor performance was based on minimizing the motion pathlength of the robot end-effector and minimizing the time to complete each trial. Skin-surface electroencephalography (EEG) and electrodermal activity (EDA) were measured to assess cognitive loading and physical arousal, respectively. For this task, multimodal ASF (i.e., visual plus haptic cues) generated the highest cognitive load as expected; however, visual ASF produced more arousal and most improved post-training performance. Our findings suggest how participant performance and physiological states are related and governable by ASF. Thus, computerized approaches, such as VR, for motor training may be optimized based on how sensory-driven guidance cues are delivered.

Original languageEnglish
Title of host publicationProceedings - 2024 IEEE 37th International Symposium on Computer-Based Medical Systems, CBMS 2024
EditorsGilberto Ochoa-Ruiz, Enrico Grisan, Sharib Ali, Rosa Sicilia, Lucia Prieto Santamaria, Bridget Kane, Christian Daul, Gildardo Sanchez Ante, Alejandro Rodriguez Gonzalez
Pages231-236
Number of pages6
ISBN (Electronic)9798350384727
DOIs
StatePublished - 2024
Event37th IEEE International Symposium on Computer-Based Medical Systems, CBMS 2024 - Hybrid, Guadalajara, Mexico
Duration: 26 Jun 202428 Jun 2024

Publication series

NameProceedings - IEEE Symposium on Computer-Based Medical Systems
ISSN (Print)1063-7125

Conference

Conference37th IEEE International Symposium on Computer-Based Medical Systems, CBMS 2024
Country/TerritoryMexico
CityHybrid, Guadalajara
Period26/06/2428/06/24

Keywords

  • augmented sensory feedback
  • motor rehabilitation
  • virtual reality

Fingerprint

Dive into the research topics of 'Augmented Sensory Feedback during Training of Upper Extremity Function in Virtual Reality'. Together they form a unique fingerprint.

Cite this