A method to establish correspondences between regions belonging to independent segmentations of multiple views of a scene is presented. The trade-off between color similarity and projective similarity of the matching regions is formulated in terms of a constrained optimization, analogous to a Rate-Distortion budget-constrained allocation problem, and solved using Lagrangian optimization techniques.