

































Study with the several resources on Docsity
Earn points by helping other students or get them with a premium plan
Prepare for your exams
Study with the several resources on Docsity
Earn points to download
Earn points by helping other students or get them with a premium plan
Community
Ask the community for help and clear up your study doubts
Discover the best universities in your country according to Docsity users
Free resources
Download our free guides on studying techniques, anxiety management strategies, and thesis advice from Docsity tutors
Image-based volumetric modeling, a technique used to build a 3d model of a scene using multiple views. The method involves calculating the visual hull and performing space carving to obtain a tight bound on the true scene. The document also covers the concept of photo consistency and the use of multiple view geometry for structure, motion, and correspondence. Additionally, it explains the process of camera calibration and the challenges of dealing with ambiguity in affine structure from motion.
Typology: Lecture notes
1 / 41
This page cannot be seen from the preview
Don't miss anything!
Greg Shakhnarovich
May 25, 2010
Basic idea: use multiple views to build a 3D model of the scene
Figures from Vogiatzis et al. 2005
Suppose we have a scene, a set of calibrated cameras, and previously obtained images from each of the cameras
If we take another set of images, and they are exactly identical to the ones we had, the scene is photo-consistent with the cameras and previous images.
If only use silhouettes: visual hull
true scene visual hull
Union of all photo-consistent scenes in the volume
Tightest bound on the true scene!
true scene visual hull photo hull
Shakhnarovich et al, 2001
Correspondence: given a 2D point in one image, establish constraints on the location of the corresponding points in other images
Structure: given corresponding 2D points in multiple images, recover 3D position of the corresponding 3D point in the scene (relative to the cameras)
Motion: estimate the relative motion of camera viewpoints between views from sets of corresponding 2D points.
Given: n images of fixed (static) 3D points X 1 ,... , Xn taken with m cameras xij is the image of Xi in camera j
Each camera is described by a projection matrix Pj
We can write projection matrix as
f 0 0 0 0 f 0 0 0 0 1 0
where K is the calibration matrix
f 0 0 0 f 0 0 0 1
Take an image of a set of points with known 3D coordinates Xi
Find corresponding 2D points xi
Recover P
P has 11 degrees of freedom
P has 11 degrees of freedom
one correspondence = two (linearly independent) constraints
homogeneous least squares: need at least six correspondences