Unsupervised 3D PET-CT Image Registration Method Using a Metabolic Constraint Function and a Multi-Domain Similarity Measure

Hengjian Yu, Huiyan Jiang, Xiangrong Zhou, Takeshi Hara, Yu Dong Yao, Hiroshi Fujita

Research output: Contribution to journalArticlepeer-review

11 Scopus citations

Abstract

High-resolution CT images can clearly display anatomical structures but does not display functional information, while blurred PET images can display molecular and functional information of lesions but cannot clearly display morphological structures. Therefore, accurate PET-CT image registration, which is used for anatomical structure and functional information fusion, is a prerequisite for early stage cancer diagnosis. However, some hypermetabolic anatomical structures, such as brain and bladder, have low registration accuracy. To solve this problem, a 3D unsupervised network based on a metabolic constraint function and a multi-domain similarity measure (3D MC-MDS Net) is proposed for 3D PET-CT image registration. Specifically, a metabolic constraint model is established based on the standard uptake value (SUV) distribution of hypermetabolic regions such as brain, bladder, liver and heart, which reduces the excessive distortion on displacement vector field (DVF) caused by hypermetabolic anatomical structures in PET images. A DVF estimator is built based on 3D unsupervised convolutional neural networks and a spatial transformer is used for warping 3D PET images to 3D CT images. The generated registration results (PET image patches) and the original 3D CT image patches are used for calculating the spatial domain similarity (SD similarity) and frequency domain similarity (FD similarity). Finally, the loss function of the entire registration network is constructed by a weighted sum of SD similarity, FD similarity and a smoothness of DVF. A dataset consisted of 170 whole-body PET-CT images is used for registration accuracy evaluation. The proposed unsupervised registration network, 3D MC-MDS Net, can accurately learn the 3D registration model by using the training dataset with the metabolic constraint model, which significantly improves the registration accuracy.

Original languageEnglish
Article number9052732
Pages (from-to)63077-63089
Number of pages13
JournalIEEE Access
Volume8
DOIs
StatePublished - 2020

Keywords

  • 3D image registration
  • PET/CT images
  • convolutional neural network
  • metabolic constraint
  • unsupervised registration

Fingerprint

Dive into the research topics of 'Unsupervised 3D PET-CT Image Registration Method Using a Metabolic Constraint Function and a Multi-Domain Similarity Measure'. Together they form a unique fingerprint.

Cite this