Multi-sensor fusion of electro-optic and infrared signals for high resolution visible images: Part I

Xiaopeng Huang, Ravi Netravali, Hong Man, Victor Lawrence

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Electro-Optic (EO) image sensors exhibit the properties of high resolution and low noise level, but they cannot reflect information about the temperature of objects and do not work in dark environments. On the other hand, infrared (IR) image sensors exhibit the properties of low resolution and high noise level, but IR images can reflect information about the temperature of objects all the time. Therefore, in this paper, we propose a novel framework to enhance the resolution of EO images using the information (e.g., temperature) from IR images, which helps distinguish temperature variation of objects in the daytime via high-resolution EO images. The proposed novel framework involves four main steps: (1) select target objects with temperature variation in original IR images; (2) fuse original RGB color (EO) images and IR images based on image fusion algorithms; (3) blend the fused images of target objects in proportion with original gray-scale EO images; (4) superimpose the target objects' temperature information, onto original EO images via the modified NTSC color space transformation. Therein, the image fusion step will be conducted by qualitative (frame pipeline) approach. Revealing temperature information in EO images for the first time is the most significant contribution of this paper. Simulation results will show the transformed EO images with the targets' temperature information.

Original languageEnglish
Title of host publicationInfrared Imaging Systems
Subtitle of host publicationDesign, Analysis, Modeling, and Testing XXIV
DOIs
StatePublished - 2013
EventInfrared Imaging Systems: Design, Analysis, Modeling, and Testing XXIV - Baltimore, MD, United States
Duration: 30 Apr 20132 May 2013

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume8706
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Conference

ConferenceInfrared Imaging Systems: Design, Analysis, Modeling, and Testing XXIV
Country/TerritoryUnited States
CityBaltimore, MD
Period30/04/132/05/13

Keywords

  • Image frame pipeline
  • Multi-sensor image fusion
  • NTSC color space transformation

Fingerprint

Dive into the research topics of 'Multi-sensor fusion of electro-optic and infrared signals for high resolution visible images: Part I'. Together they form a unique fingerprint.

Cite this