TY - JOUR
T1 - Fluid in video
T2 - 29th Annual Conference on European Association for Computer Graphics, EUROGRAPHICS 2008
AU - Kwatra, Vivek
AU - Mordohai, Philippos
AU - Narain, Rahul
AU - Penta, Sashi Kumar
AU - Carlson, Mark
AU - Pollefeys, Marc
AU - Lin, Ming C.
PY - 2008
Y1 - 2008
N2 - We present a technique for coupling simulated fluid phenomena that interact with real dynamic scenes captured as a binocular video sequence. We first process the binocular video sequence to obtain a complete 3D reconstruction of the scene, including velocity information. We use stereo for the visible parts of 3D geometry and surface completion to fill the missing regions. We then perform fluid simulation within a 3D domain that contains the object, enabling one-way coupling from the video to the fluid. In order to maintain temporal consistency of the reconstructed scene and the animated fluid across frames, we develop a geometry tracking algorithm that combines optic flow and depth information with a novel technique for "velocity completion". The velocity completion technique uses local rigidity constraints to hypothesize a motion field for the entire 3D shape, which is then used to propagate and filter the reconstructed shape over time. This approach not only generates smoothly varying geometry across time, but also simultaneously provides the necessary boundary conditions for one-way coupling between the dynamic geometry and the simulated fluid. Finally, we employ a GPU based scheme for rendering the synthetic fluid in the real video, taking refraction and scene texture into account.
AB - We present a technique for coupling simulated fluid phenomena that interact with real dynamic scenes captured as a binocular video sequence. We first process the binocular video sequence to obtain a complete 3D reconstruction of the scene, including velocity information. We use stereo for the visible parts of 3D geometry and surface completion to fill the missing regions. We then perform fluid simulation within a 3D domain that contains the object, enabling one-way coupling from the video to the fluid. In order to maintain temporal consistency of the reconstructed scene and the animated fluid across frames, we develop a geometry tracking algorithm that combines optic flow and depth information with a novel technique for "velocity completion". The velocity completion technique uses local rigidity constraints to hypothesize a motion field for the entire 3D shape, which is then used to propagate and filter the reconstructed shape over time. This approach not only generates smoothly varying geometry across time, but also simultaneously provides the necessary boundary conditions for one-way coupling between the dynamic geometry and the simulated fluid. Finally, we employ a GPU based scheme for rendering the synthetic fluid in the real video, taking refraction and scene texture into account.
UR - http://www.scopus.com/inward/record.url?scp=42949089248&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=42949089248&partnerID=8YFLogxK
U2 - 10.1111/j.1467-8659.2008.01146.x
DO - 10.1111/j.1467-8659.2008.01146.x
M3 - Conference article
AN - SCOPUS:42949089248
SN - 0167-7055
VL - 27
SP - 487
EP - 496
JO - Computer Graphics Forum
JF - Computer Graphics Forum
IS - 2
Y2 - 14 April 2008 through 18 April 2008
ER -