Matching Constraints for Points in Image Triplets

The animation (generated with Cinderella) visualizes the general configuration of an image triplet observing a 3D point and the need for a trifocal constraint.

The animation shows the projection of the point X to the three image points x', x'', and x''' in the three images having projection centres O', O'', and O'''. The six epipoles {e'2,e'3}, {e''3,e''1}, and {e'''1,e'''2} are the projections of the projection centres O', O'', and O''' into the other two images. The three projection lines Lx'=(O'X), Lx''=(O''X), and Lx'''=(O'''X) are shown in red, blue, and green. They map to the six epipolar lines {(x'e'2),(x'e'3)}, {(x''e''3),(x''e''1)}, and {(x'''e'''1),(x'''e'''2)}.

The two image points x' and x'' of the 3D point X in the image pair (O',O'') need to fulfil the epipolar constraint, namely that the image point x'' passes through the (red) epipolar line (x''e''1) being the image of the (red) projection ray Lx' into the second image. The epipolar constraint actually means: the two projection rays Lx' and Lx'' must intersect, or formally ι(Lx',Lx''). Similarly, we can argue for the other two image pairs (O''O''') and (O'''O'). Each of these constraints has one degree of freedom.

The six coordinates of x', x'', and x''' need to fulfil three constraints, since the 3D point has three coordinates. In general, the three epipolar constraints in the three image pairs are sufficient: (1) The first constraint ι(Lx',Lx'') fixes the 3D point, and (2) the constraint that X sits on Lx''' are the other two constraints on the coordinates of x''', namely that x''' sits on the intersection point of the two epipolar lines e'''1 and e'''2.

However, the situation is different, in case the point X sits on the trifocal plane, i.e. on the plane (O'O''O'''), a situation which arises always in image sequences on a straight path, since all trifocal planes form a bundle through consecutive projection centres, such that all 3D points lie in a trifocal plane. Then the two constraints in (2) reduce to one constraint, since the two epipolar lines e'''1 and e'''2 are identical, i.e. the point x''' can sit anywhere along these epipolar lines. Therefore, a constraint between all six image coordinates is necessary: The three projection rays, when mapped to the trifocal plane, need to intersect, here in point F. This trifocal constraint has one degree of freedom, and needs to augment two of the epipolar constraints to enforce consistency between all six image coordinates.

In the animation one can change the position of X, by moving F in the trifocal plane and shifting X in orthogonal direction. In addition one can change the height d of the images on the left.

Explore the configuration:

  1. - Visually verify the three epipolar constraints.
  2. - Move F onto one of the lines joining two projection centres, and verify that also in this situation the three epipolar constraints are sufficient.
  3. - Move X into the trifocal plane, and verify that the three epipolar constraints are not sufficient to constraint all six image coordinates.
  4. - Why has the trifocal constraint one degree of freedom?