Towards Enhancing Extended Reality for Healthcare Applications with Machine Learning

Pranav Parekh, Richard O. Oyeleke

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Extended Reality is expanding in healthcare with regard to the quality of vision the operator experiences. On the other hand, machine learning has provided numerous capabilities to enhance user interaction. This paper focuses on using the visualizations of extended reality (XR) methods alongside functionalities provided by intelligent systems. We propose three hypothetical methods for integrating the two fields to provide healthcare solutions. The three use cases of treatment visualization, therapeutic strategies and decision-making are proposed to enhance healthcare. The treatment visualization case uses image segmentation and virtual reality (VR). We segment the medical image that the medical worker visualizes through the VR headset. We propose an adaptive mixed reality system that can change according to the user’s mood for appropriate therapy. Neural models recognize the user’s emotions and adapt the system accordingly. An augmented reality chatbot has been proposed to influence timely decision-making during medical situations. Each case study uses different tools from the other and focuses on a specific healthcare-related solution.

Original languageEnglish
Title of host publicationAI Technologies and Virtual Reality - Proceedings of 7th International Conference on Artificial Intelligence and Virtual Reality AIVR 2023
EditorsKazumi Nakamatsu, Srikanta Patnaik, Roumen Kountchev
Pages313-330
Number of pages18
DOIs
StatePublished - 2024
Event7th International Conference on Artificial Intelligence and Virtual Reality, AIVR 2023 - Kumamoto, Japan
Duration: 21 Jul 202323 Jul 2023

Publication series

NameSmart Innovation, Systems and Technologies
Volume382
ISSN (Print)2190-3018
ISSN (Electronic)2190-3026

Conference

Conference7th International Conference on Artificial Intelligence and Virtual Reality, AIVR 2023
Country/TerritoryJapan
CityKumamoto
Period21/07/2323/07/23

Keywords

  • Augmented reality
  • Computer vision
  • Extended reality
  • Machine learning
  • Mixed reality
  • Natural language processing
  • Neural networks
  • Virtual reality

Fingerprint

Dive into the research topics of 'Towards Enhancing Extended Reality for Healthcare Applications with Machine Learning'. Together they form a unique fingerprint.

Cite this