An approach for shape from surface normals with local discontinuity detection

Yilin Wang, Enrique Dunn, Jan Michael Frahm

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

We present a multi-modal surface reconstruction approach, which utilizes direct surface orientation measurements along with luminance information to obtain high quality 3D reconstructions. The proposed approach models local surface geometry as a set of intersecting natural cubic splines estimated through least squares fitting of our input pixel-wise surface normal measurements. We use this representation to detect discontinuities and segment our scene into disjoint continuous surfaces, which are constructed by an aggregation of connected local surface geometry elements. In order to obtain absolute depth estimates, we introduce the concept of multi-view patch sweeping, where we search for the most photo-consistent patch displacement along a viewing ray. Our approach improves on existing shape from normals methods by enabling absolute depth estimates for scenes with multiple objects. Furthermore, in contrast to existing multi-view stereo methods, we are able to reconstruct textureless regions through the propagation of relative surface orientation measurements. Experiments on synthetic and real data are presented to validate our proposal.

Original languageEnglish
Title of host publicationProceedings - 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission, 3DIMPVT 2011
Pages188-195
Number of pages8
DOIs
StatePublished - 2011
Event2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission, 3DIMPVT 2011 - Hangzhou, China
Duration: 16 May 201119 May 2011

Publication series

NameProceedings - 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission, 3DIMPVT 2011

Conference

Conference2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission, 3DIMPVT 2011
Country/TerritoryChina
CityHangzhou
Period16/05/1119/05/11

Keywords

  • Discontinuity detection
  • Multi-view patch sweeping
  • Shape from surface normal

Fingerprint

Dive into the research topics of 'An approach for shape from surface normals with local discontinuity detection'. Together they form a unique fingerprint.

Cite this