Skip to main navigation Skip to search Skip to main content

Conditional Diffusion Model Optimization for Real-Time Point-of-Care Image-Quality Enhancement on Nvidia Jetson Orin Nano

  • Tharun Kumar Jayaprakash
  • , Ye Tian
  • , Jedrzej Golebka
  • , Royce W.S. Chen
  • , Yu Gan
  • , Kaveri A. Thakoor
  • Columbia University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

High-resolution optical coherence tomography (OCT) is often inaccessible in low-resource settings. While diffusion models can enhance low-cost OCT scans, their computational cost prohibits embedded deployment. We solve this problem by presenting the first real-time deployment of a diffusion-based OCT enhancement model on an Nvidia Jetson Orin Nano. Our systematic pipeline achieves a 33 ms inference time by first pruning the model from 224 M (million) to 42.9 M parameters (80.8% reduction) with minimal fidelity loss (no statistically significant difference in quality (p>0.3) ). We then apply a novel hybrid INT8 quantization approach, strategically offloading unstable Softmax operations to a lightweight custom CUDA kernel. Expert evaluation shows that downstream diagnostic utility of the resulting images is also not impacted. This work provides a concrete blueprint for translating large generative models into practical, affordable medical diagnostic tools.

Original languageEnglish
Title of host publicationISBI 2026 - 23rd IEEE International Symposium on Biomedical Imaging
ISBN (Electronic)9798331577636
DOIs
StatePublished - 2026
Event23rd IEEE International Symposium on Biomedical Imaging, ISBI 2026 - London, United Kingdom
Duration: 8 Apr 202611 Apr 2026

Publication series

NameProceedings - International Symposium on Biomedical Imaging
Volume2026-April
ISSN (Print)1945-7928
ISSN (Electronic)1945-8452

Conference

Conference23rd IEEE International Symposium on Biomedical Imaging, ISBI 2026
Country/TerritoryUnited Kingdom
CityLondon
Period8/04/2611/04/26

Keywords

  • Diffusion Models
  • Embedded AI
  • Medical Imaging
  • Model Compression
  • Optical Coherence Tomography
  • Targeted Graph Surgery
  • TensorRT

Fingerprint

Dive into the research topics of 'Conditional Diffusion Model Optimization for Real-Time Point-of-Care Image-Quality Enhancement on Nvidia Jetson Orin Nano'. Together they form a unique fingerprint.

Cite this